ADA039243 


Report  6148-A002 


D D C 


RESEARCH  IN  INFORMATION  THEORY 

c 


Dr.  J.  P.  Schallcwijk,  Eindhoven  University  of  Technology 

K.  A.  Post,  Eindhoven  University  of  Technology 

A.  J.  Vinck,  Eindhoven  University  of  Technology 

LINKABIT  Corporation 

10453  Roselle  Street 

San  Diego,  CA  92121 


9 May  1977 

Scientific  and  Technical  Report  - PINAL 
Period  12  April  1976  - 11  April  1977 


DISTRIBUTION 

Approved  for  public  release,  distribution  unlimited. 


Prepeured  for 

NAVAL  REGIONAL  PROCUREMENT  OFFICE 
Long  Beach,  CA  90822 

Delivered  to 
SUPPLY  OFFICER 

NAVAL  ELECTRONICS  LABORATORY  CENTER 
271  Catalina  Blvd. 

San  Diego,  CA  92152 


Mil 


StCUWITY  CUAOriCATlOW  Of  TMiS  ^ACC  Ot*  SnfmQ 

REPORT  DOCUMENTATION  PAGE  aEFORE°c^PLSg"oRM 

I.  nl^Olt’f'NUMAIK  |2.  OOVT  ACCESSION  NO.  3-  KKCOICNT'S  CATACOO  NUMSSR 

6148>A002 


«.  TtTUK  rand  SuMM*> 

RESEARCH  IN  INFORMATION  THEORY 


AUTHORfO 

J.  P.  M.  ScheU.]cwijk 

K.  A.  Post 
A.  J.  VlncJc 


Eindhoven 
University  of 
Technology 


t.  FIRroHMINQ  OROANIZATION  NAMC  AMO  AOORCSS 

LINKABIT  Corporation 
10453  Roselle  Street 
San  Diego » CA  92121 

II.  COMTROWUMO  OFFICE  MAMS  AMO  AOORCSS 

Naval  Regional  Procurement  Office 
Long  Beach,  CA  90822 


5.  TYRK  OF.RCfORT  * RCRIOO  COVCRfi 

Scientific . & Technical 
frti  U April 


& Technical 
nal 

to  11  April?' 


«.  RCRFORMING  ORO.  RCRORT  NUMCCR 

6148-A002 

S.  contract  or  SRANI’  NUMCi^a> 

N00123-76-C-0842 


10.  PROORAM  CLCmCNT.  FROJCCT,  TASK 
ARCA  S WORK  UNIT  NUMOCRS 


XR0210S 

YR0210S01 

N438 

13.  RCRORT  OATC 

9 May  77 

13.  NUMCCR  OF  RAOCS 


MONITORING  AOCNCr  NAMC  A AOORCSS^’i/  OlHtmit  Inm  CantntllnS  OtHem)  IS.  SECURITY  CLASS,  (ol  UMa  iwpatl) 

ONCLASSIFia 


; IS.  oistrigutiom  statcmcnt  (oi  r*rwo 


Distribution  A Approved  for  public  release,  distribution 

unliiaited. 


17.  OISTRICUTtON  STATCMCNT  Ca/ M*  a*«(rae(  I 

Same 


I In  Stock  30,  It  dittcrcnt  kcm  Scpoct) 


IS.  surrlcmcntary  notes 

None 


I tt.  key  WOIROS  rCdiKlmM  M firm—  H ^ i 


None 


30.  ACSTRACT  rcondnu*  on  rmcmco  dCm  II  ncecccorr  mS  lOcntllr  *r  Mock  mmkot) 

This  paper  concerns  a state  space  approach  to  syndrome  decoding  of 
binary  rate-k/n  convolutional  codes.  State  space  symmetries  of  a 
certain  class  of  codes  can  be  exploited  to  obtain  eui  exponential 
reduction  of  decoder  hardware.  Aside  from  these  heurdware  savings, 
it  is  felt  that  the  state  space  formalism  developed  in  this  report 
has  some  intrinsic  value  of  its  own. 


f 


DD  1473  COITION  OF  I NOV  S3  IS  OCSOLCTC 


UNCLASSIFIED 

security  CLASSIFICATION  OF  THIS  RAGE  fRh»n  Dote  SntcreC) 


ABSTRACT 

This  paper  concerns  a state  space  approach  to  syndrome 
decoding  of  bineury  rate-k/n  convolutional  codes.  State  space 
syimnetries  of  a certain  class  of  codes  can  be  exploited  to 
obtain  an  exponential  reduction  of  decoder  hardware.  Aside 
from  these  heurdware  savings,  it  is  felt  that  the  state  space 
formalism  developed  in  this  report  has  some  intrinsic  value 
of  its  own. 


,1- 


3.0  Soft  Decision  Syndrcnae  Decoding — — — — — 5X 

4.0  Union  Bound  on  the  Error  Probability————  66 

5.0  Conclusions— — 71 

• APPENDIX 

Syndrome  Decoding  of  Binary  Rate  1/2 
Convolutional  Codes 


ii 
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INTRODUCTION 


At  the  steurtlng  point  of  the  present  line  of  research 
is  an  optijnal  coding  strategy  for  the  binary  syonnetric  channel 
with  noiseless  feedback,  see  J.P.M.  Schalkwijk,  "A  Class  of 
Sisaple  amd  Optimal  Strategies  for  Block  Coding  on  the  Binaory 
Symmetric  Chauinel  with  Noiseless  Feedback,”  IEEE  Tramsactions 
on  Information  Theory,  Vol.  IT-17,  pp.  283-287,  May,  1971. 

This  coding  strategy  is  optimal  in  that  it  achieves  the 
minimum  possible  error. probability  for  a given  trauismission 
rate.  In  addition,  it  cam  be  shown  that  this  minimal 
achievadsle  error  probability  cam  be  realized  with  a decoder 
that  meets  the  lower  bound  on  the  con^utational  complexity 
for  the  paurticular  task  at  hand.  The  only  drawback  of  otir 
coding  strategy  is  that  it  requires  as  side  information  at 
the  transmitter  a (possible  delayed)  copy  of  channel  noise. 
This  side  information  cam,  as  in  the  above  reference,  be 
provided  by  a noiseless  feedback  chamnel.  Returning  the 
received  information  via  the  feedback  chamnel  amd  comparing 
it  with  what  was  transmitted  one  obtains  a (delayed)  copy 
of  the  forward  noise. 

It  was  soon  realized  that  the  requirement  of  a noise- 
less feedback  channel  posed  a severe  constraint  on  the  use 
of  our  coding  strategy  in  mamy  practical  situations.  Assum- 
ing the  availability  of  a duplex  channel  consisting  of  a BSC 
in  each  direction,  one  cam  obtain  a copy  of  the  forward  noise 


a't  the  active  station  by  returning  a linearly  scrambled 
version  of  the  received  data#  see  IEEE  Tremsactions  on 
Communications,  Vol.  COH-22,  pp.  1369-1374,  September, 
1974.  In  the  Appendix,  it  is  explained  how  the  lineeu: 
forward  scraunbler  of  the  aUbove  reference  was  replaced 
by  a more  effective  feedback  scrambler.  We  thus  obtain 
an  extremely  efficient  strategy  for  error  control  on 
duplex  channels. 


The  duplex  strategy  has  an  even  more  important 
aspect  aside  from  efficient  error  control.  Assume  a 
multiple  dialogue  system  (MDS)  consisting  of  a central 
computer  with,  for  example,  25  satellite  computers. 
Operating  the  communication  from  the  central  facility 
towards  a satellite  in  the  traditional  one-way  mode 
would  require  25  decoders,  one  at  each  satellite  conqputer. 
Using  our  duplex  strategy  for  commiinicating  from  the 
center  towards  the  satellites  requires  one  single  decoder 
' at  the  central  facility.  This  decoder  also  handles  the 
information  flow  from  a satellite  computer  to  the  central 
facility.  Hence,  using  our  duplex  strategy  in  the  above 
computer  communication  network  one  saves  25  decoders,  l.e., 
as  many  as  there  are  satellite  computers. 


An  important  part  of  the  duplex  strategy,  see  IEEE 
Transactions  on  Communications,  Vol.  COM-22,  pp.  1369-1374, 
September,  1974,  is  the  circuit  that  forms  an  estimate  at 


the  active  station  of  the  forweurd  noise.  Aside  from  being 
a crucial  part  of  the  duplex  scheme  this  circuit  is  impor- 
tant  in  that  it  can  also  be  used  for  data  compression  pur- 
poses and  as  the  core  part  of  a syndrome  decoder  for  binary 
rate  1/2  convolutional  codes r as  explained  in  the  i^pendix. 
We  were  struck  by  the  imbalamce  in  heurdware  complexity 
between  the  feedback  strategy  as  implemented  at  a satellite 
station r and  the  hardware  complexity  of  the  syndrome  de- 
coder at  the  central  terminal.  Hence , our  main  research 
effort  as  described  in  Section  2.0  has  been  aimed  at  re- 
ducing the  complexity  of  syndrome  decoders  for  binaory  rate 
k/n  convolutional  codes.  Aside  from  the  results  on  reduced 
decoder  hardware.  Section  2.0  is  importeint  in  that  it  intro- 
duces a state  space  formalism  that  appears  to  be  a valuable 
tool  in  the  theory  of  convolutional  codes. 

Section  3.0  concerns  syndrome  decoding  with  soft 
decisions.  In  practice,  when  using  Viterbi  decoding  on 
satellite  channels  roughly  2 dB  in  signal-to-noise  ratio 
can  be  gained  by  going  from  2 to  8 level  quantization  at 
the  receiver.  The  aim  of  the  research  effort  described 
in  Section  3.0  was  to  investigate  how  much  of  the  heurdware 
savings  obtained  in  the  Appendix  for  syndrome  decoding  can 


quantization  at  the  receiver,  one  should  still  prefer  syn- 
drome decoding  over  regular  Vlterbi  decoding.  We  are 
presently  Investigating  the  possibilities  of  syndrome  de- 
coding over  FG  ( 3 ) , but  it  is  still  too  eeurly  to  draw  emy 
conclusions. 

Section  4.0,  finally,  describes  a method  to  exactly  ^ 
evaluate  Viterbi's  union  bound  on  the  first  event  error 
probed>lity  imd  on  the  bit  error  probablity  for  nuucimum 
likelihood  decoding  of  convolutional  codes.  These  results 
present  a further  improvement  on  an  eeurlier  bounding  tech- 
nique described  by  L.  v.d.  Meeberg,  see  IEEE  Transactions 
on  Information  Theory,  Vol.  IT-20,  pp.  389-391,  May,  1974. 
The  results  of  Section  4.0  will  appear  in  the  IEEE  Trans- 
actions on  Information  Theory,  March,  1977. 
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I.  INTRODUCTION 


This  paper  concerns  a state  space  approach  to  syndrome  decoding 
of  binary  rate-k/n  convolutional  codes.  It  extends  and  generalizes 
earlier  work  [1,  2,  3]  on  syndrome  decoding  of  binary  rate*i  convo- 
lutional codes.  In  Sections  II,  and  1 1 1 we  develop  a concise  mathe- 
matical formulation  of  the  problem.  Section  IV  introduces  a special 
class  of  binary  rate-(n-1)/n  convolutional  codes.  It  is  shown  that 
the  state  space  symmetries  of  this  class  of  codes  allow  for  an 
exponential  reduction  of  decoder  hardware.  Section  V extends  the 
results  of  the  previous  section  to  rate-k/n  codes.  Table  I lists 
the  free  distance  of  some  short  constraint  length  codes  that  exhibit 
the  required  symmetries. 

Fig.  1 shows  a conventional  [4]  binary  rate-2/3  convolutional 
encoder  with  2 memory  elements.  The  input  to  this  encoder  are 
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two  binary  massage  saquancas 


^ ^ ,ni|  Q •iii|  ^ • { I ■ 1(2  . 


Tha  outputs  ara  thraa  binary  codaword  saquancas  <c^>,  <C2>» 


and  <c^>  (hanca  tha  rata  Is  2/3).  Tha  elemants  of  tha  thraa 
output  saquancas  <c^>,  <C2>>  and  <c^>  are,  respectively, 


®1,t  ■ "*1,t*  "l,t-l  ® "’2,t 


®2,t  " ™l,t-l  ® '"2,t 


®3,t  • ®l,t*  "l,t-l  ® '"2,t-l 


where  9 denotes  modulo  2 addition. 


With  tha  input  and  output  sequences,  wa  associate  sequences  in 


the  delay  operator  X: 


™.(X)  ■ ...  ■¥  mj  _^X  + g + m.^X  + + ...  ; i ■ 1,2 


Cj(X)  - ...  Cj  .^X  Cjg  + Cj^X  Cj2^  + ...  ; J ■ 1,2,3, 


For  notational  convenience  wa  shall  generally  suppress  the  parenthetical 


X in  our  subsequent  references  to  sequences;  thus  m.  means  m^CX), 


Cj  ■ Cj(X),  and  so  forth,  where  the  fact  that  a letter  represents  a 
sequence  (transform)  should  be  clear  from  the  context.  Now  the  input/ 


output  relationships  are  expressed  concisely  as 


£ ■ mG  , 


x.’to.N^v^.ws'L  ' 


VfA 


v:* 


h:v, 


I'.  <*. 
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where  m ■ (mpffl2)  » £ * (c^»C2tC^)  , and  the  generator  matrix 


G - [9jj(X)]  is 


UX  X UX 


and  formal  power  series  mul tipi ication  with  coefficient  operations 
modulo  2 is  applied.  In  general,  let  there  be  k inputs  and  n outputs. 
If  we  define  the  constraint  length  for  the  i*th  input  as 


V.  - max  [deg  g.j(X)] 
Icjcn 


then  the  overall  constraint  length 


I Vs 


(v>2  for  the  encoder  of  Fig.  1),  equals  the  number  of  memory  elements 
for  what  Forney  [4]  calls  the  obvious  realization  of  the  encoder. 


The  dual,  C**,  code  [5]  to  a convolutional  code  C is  the  linear 
space  generated  by  the  set  of  all  n~tuples  of  finite  (for  infinite 
sequences  the  inner  product  may  not  be  defined)  sequences  ^(X)  such 
that  the  inner  product  (£,£)  ^ (where  T means  transpose)  is  zero 

for  all  £ in  C.  The  dual  code  of  a rate*k/n  convolutional  code, 
generated  by  an  encoder  G,  is  a rate’-(n-k)/n  code  that  can  be  generated 
by  a suitable  encoder  H,  such  that  GH^  • 0.  The  matrix  can  be 


gnRm«m 


UHJHIM 


am 


^g^’^FT'^y  • w\M  m-m.. 


I 
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obtained  from  the  inverse  of  the  B matrix  in  an  invariant  factor 
decomposition  [4,  5]»  G ■ AFB,  of  the  encoder  matrix  G by  taking  the 


.-1 


last  n'k  columns  of  B . The  n-input,  (n-'k)*^utput  linear  sequential 


circuit  whose  transfer  function  matrix  is  H Is  called  a syndrome 


former,  and  has  the  property  that  cH  « 0 if  and  only  if  £cC. 


For  the  encoder,  G,  of  Fig.  1 we  have  an  invariant  factor  de- 
composition 


‘l+X 

X 

l+X" 

X 

1 

1 

0 

0 ■ 

. 1 

1 

X 

. 1 

0 , 

0 

1 

0. 

1 


1 1 

1 0 1+X+X^ 

0 0 1 


Hence, 


1 

1 

X 

0 

1 

1+X+X^ 

1 

0 

1+X+X^ 

, so  B ^ ■ 

1 

1 

1+X^ 

0 

0 

1 

0 

0 

1 

-1 


The  H matrix  is  now  given  by  the  last  column  of  the  B matrix,  i.e. 


h". 


l+X+X- 


1+X" 

1 


Fig.  2 gives  the  obvious  realization  of  the  syndrome  former.  Two 
comments  are  in  order.  First,  note  that  for  rate-(n-1)/n  codes  the 
syndrome  former  has  n inputs  but  a single  output,  compare  Fig.  2. 
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This  single  output  is  the  reason  that  in  Sections  II,  III,  and  IV 
Me  first  concentrate  on  rate*'(n-1)/n  codes.  Second,  in  Table  II  of 
Section  V Me  list  codes  In  terms  of  their  syndrome  formers.  The 
invariant  factor  theorem  can  now  be  used  on  the  matrix  H,  i.e. 

H a CrO,  to  find  from  the  0 ^ matrix  a suitable  encoder  G.  This 
encoder  is  conventionai  (i.e.  it  has  no  feedback),  but  it  is  not 
necessarily  minimal  [4],  i.e.  the  obvious  realization  does  not 
necessarily  have  the  smallest  possible  number  of  memory  elements. 


Let  £(x)  be  the  error  vector  sequence,  and  let  £ ■ £ + ^ be  the 
received  data  vector  sequence.  We  then  define  the  syndrome  vector 
sequence  (ii(X)  as 


i . I ntroduct ion  7 

The  task  of  the  codeword  estimator  [4]  is  now  to  find  an  error  vector 
sequence  estimate  i(X)  of  minimum  Hamming  weight  that  can  be  a possible 
cause  of  the  syndrome  vector  sequence  ^(X) . The  codeword  vector 
sequence  estimate  ^(X)  is  then  given  by 

2 - r + 8 . 

Using  the  codeword  vector  sequence  estimate  S(X),  the  inverse  en- 
coder G ^ now  forms  an  estimate  i1i(X)  of  the  message  vector  sequence 
m(X),  i.e^ 


^ “ 26  ' » 


where  6*^  is  a right  inverse  of  G,  i.e.  G6*'  ■ I.  This  inverse 
encoder,  G*\  can  also  (i.e.  like  the  syndrome  former)  be  obtained 
from  the  Invariant  factor  decomposition  G ■ ATB  of  the  encoder  G. 
For  the  encoder  G of  Fig.  1 we  have 


6*^  • - 


I 1+X+X' 


1 1 
0 0 


1+X‘ 

1 


» « 
1 0 

0 1 

0 0 
» « 

0 1 
1 X 


1 X 
1 UX 
0 0 


Fig.  3 gives  the  obvious  realization  of  the  inverse  encoder  G \ 

Note  that  both  G,  and  G ^ represent  one-to-one  (and  in  fact 
linear)  maps  that  can  be  realized  with  simple  circuitry,  compare 
Figs.  1,  and  3«  The  codeword  estimator  determines  both  the  complexity 
and  the  performance  of  the  system.  Section  II  deals  with  the  state 
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Fig.  3*  An  inverse  encoder  for  the  rate-2/3  convoiutionai  code 
of  Fig.  1. 

space  of  the  syndrome  former  of  a binary  rate-(n-1)/n  convoiutionai 
code.  Section  III  gives  a description  of  the  codeword  estimator  in 
terms  of  the  state  space  framework  developed  in  Section  II.  As  it 
turns  out  certain  symmetries  in  the  syndrome  former  state  space  can 


be  exploited  to  greatly  reduce  the  complexity  of  the  codeword 
estimator.  This  line  is  persued  in  the  remainder  of  the  paper. 

Before  embarking  on  our  state  space  approach  (which  is  the  core 
of  this  paper)  towards  the  codeword  estimator  one  final  comment  is 
in  order.  The  estimate  ^(x)  of  the  message  vector  sequence  m(X)  can 
also  be  written  as 

i ■ W”'  ■ I?"'  ♦ • 
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9. 


Tho  first  term  rG  ^ on  the  RHS  of  ebove  eqn.  can  be  easily  obtained 
from  the  received  data  vector  sequence  £(X)  using  the  simple  circuitry 
of  Fig.  3.  As  in  refs.  [1,  2,  3]»  it  turns  out  that  the  overall 
decoder  requires  less  hardMsre  if  we  let  the  estimator  determine  the 
second  term*  iG  directly.  Hence,  we  define  the  message  (as  opposed 
to  the  codeword)  vector  sequence  correction,  l.(x) ... 

4 K''  . (2) 

I 


ss 


o'- 


u 


8 
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For  a stata  spaca  analysis  it  is  convanient  to  represant  tha  syndrome 
fomar  of  a rate*‘(n-1)/n  coda  by  an  n>tupla  (A,B,C,. . . ,0)  of  binary 
polynomials,  saa  Fig.  k.  Tha  n~tupla  (A,B,C,. . . ,D)  Is  obtalnad  from  tha 


matrix  H • [h^ (X) ,h2(X) . ,h^(X)]  of  Section  I by  putting  aj  “ h^j, 
bi  - h^j,  Cj  - hjj,...,d|  ■ h^j,  i«K),l,2 h,  vdiere 

h ■ max  dag  h,(X)  . 

UjSn  J 


Obviously,  one  single  noise  vector  In  the  sequence  ...,[e^ 

*2,-1 * ’*n,-l^  ’ f*10’*20’*  ** ’*n0^  ’ f*1 1 **21  ’ * * * ’*n1^ 

most  Influence  h4>1  successive  syndrome  digits.  We  define  the  "physical 

state"  of  the  system  to  be  the  nh-dimensional  binary  vector  representing 

tha  contents  of  all  shift  register  stages  in  Fig.  4.  Every  noise  vector 

that  enters  the  system  causes  a transition  of  its  physical  state  and 
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1 1 . State  Space  1 1 . 

gives  rise  to  a binary  syndrome  digit.  The  phenomenom  occurs  that  two 
different  Initial  physical  states  are  syndrome* Indistinguishable,  I.e. 
that  under  every  noise  vector  sequence  [•^Qf*20*"  * '*n0^^'^*1 1 '*21 ' * * ' * 
*n1^^'*’*  syndrome  sequences  are  Identical.  It  is  left  to  the 

reader  [3,^]  to  prove  that  this  natural  concept  of  syndrome* I nd is* 
tinguishabi I Ity  Is  exactly  the  same  as  the  following  equivalence 
relation:  Two  physical  states  are  called  equivalent  If  their  difference 
has  a sequence  of  syndrome  digits  identically  zero  under  a sequence  of 
noise  vectors  Identically  zero.  In  fact,  we  may  restrict  ourselves  in 
this  definition  to  sequences  of  zero*noise  vectors  of  length  h,  since 
all  following  zero*noise  vectors  simply  must  yield  zero*syndrome  digits. 

The  equivalence  classes  of  the  above  equivalence  relation  will  be 
called  "abstract  states",  of  briefly  "states"  of  the  system.  There  are 
several  equivalent  state  descriptions.  In  ref.  [3]  Schalkwijk  and  VInck 
use  the  contents  of  the  bottom  register  0 of  the  syndrome  former. 

Fig.  I»,  as  a description  of  the  state.  Forney  [4]  uses  the  zero*noise 
syndrome  sequence  to  represent  the  state.  In  the  present  paper  we  opt 
for  this  latter  description. 

We  are  now  ready  to  introduce  some  convenient  notation:  States 
(given  by  their  zero*noise  syndrome  sequence)  are  denoted  by  lower 
case  greek  letters  with  a subscript,  e.g. 


0|  ^ (s^,S2vS^,...,  *^h*l  *h^  * Its  I ef  t shifts 

®2  ^ (*2»*3»*4»* • • **h*l ,*h'®^ ' 


so  on. 
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Occasionally,  I.e.  If  sufficiently  many  terminating  components 
venlsh,  we  also  write  the  right  shifts,  e.g. 

“ ^®»*l’*2***‘**h-3’V2**h-l^  *h"®’ 

Finally,  we  Introduce  the  symbols  to  denote  the 

generator  states  of  the  system,  I.e. 


■ [a^  ,a2»  • • • ,a|^] , 
S'!  “ [h|  ,b2» . • • ,b|^] , 
Yi  ■ [c^  »®2**  * * * 


S|  ^ *^2* * * * * 


Without  loss  of  generality  we  assume  This  assumption  Is  Justified 

by  the  definition  of  h and  implies  thet  the  state  spece  has  dimension  h. 


The  output  of  the  syndrome  former,  see  Fig.  4,  at  time  t and  the 
state  at  time  t>1  are  completely  determined  by  the  state  o^  and  the 
Input  ^ *^2^*^^^ t • • • ,e^^]  at  time  t,  t*...,*1 ,0,^1 ,...  . 

As  the  syndrome  former  Is  supposed  to  be  time  invariant  there  is  no 
purpose  in  retaining  the  subscript  t in  the  state  space  analysis.  Thus, 
we  denote  the  syndrome  former  input  by  [x,y,z, . . . ,t]^.  The  corresponding 
state  transition  and  the  owtout  u are  given  by 
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13. 


»y  • • • » 


Ci  Oj  *►  xo^  ♦ yS^  ♦ rY|  + . . . ♦ t6^ 


r « I w w 

\ 


«rt  - ♦ xajj  ♦ ybg  ♦ 2Cq  •*•  . . . td^  . 

Fig.  5 gives  the  state  diagram  of  the  syndrome  former  of  Fig.  2. 
Solid  lines  correspond  to  a syndrome  digit  uaO  and  dashed  lines  to  a 


Fig.  S.  State  diagram  of  syndrome  former. 


(3) 


II.  State  Space 


syndrome  digit  u>a1 . Indicated  along  the  edges  are  the  numerical  values 
of  »S2**** ’*m2'* * * **mk^  Intepreted  as  binary  numbers, 
where  the  latter  vector  represents  the  generic  term  * * * * 

^mkt^  • t*. . . ,-1 ,0,4>1 , . . . , of  the  message  vector  sequence  correction 
S (X)  of  (2),  with  the  redundant  subscript  t removed. 

" TU 

The  fact  that  the  message  vector  correction  Is  solely  determined  by 
the  next  state  [3],  see  Fig.  5,  follows  from  Forney  [5].  According  to 
Forney  the  syndrome  former  state  uniquely  determines  the  encoder  state 
and  vise  versa  If  G and  are  connected  by  a noiseless  (dashed  in 
Fig.  6)  channel.  The  vector  sequence  in  Fig.  6 is  such  that 


Fig.  6.  Encoder  and  syndrome  former  connected  back  to  back. 


“ 8^  G s tears  the  syndrome  former  to  the  same  state  at  time  t, 

• * in 

t>. . . ,*1 ,0,-fl ,. . . , as  does  ^(X).  As  we  can  equate  the  encoder  state 
to  Its  recent  inputs,  *^mkt^  '*  determined 


by  the  state  of  the  syndrome  former  at  time  t+1 , t«. . . ,-l ,0,+l , . . . . 
.-1 


But,  as  G is  an  instantaneous  right  inverse  of  G we  have  [8 

ml  t 

••••*mkt^  ■ ^*^mlt *^mkt^  ' «"• • • . • • • • 
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Nom  consider  the  linear  subspace  spanned  by  the  generators  , 
this  subspace  has  dimension  q then  according  to 
(3)  each  state  has  exactly  2^  state  transition  images.  Again  by 
(3)»  these  images  from  a coset  of  the  linear  subspace  L[a^,6pY^, 
...id^].  This  coset  will  be  called  the  "sink-tuple"  of  . 


The  linear  subspace  L[apB^,y^ 5^]  is  identical  to  the  linear 

subspace  L[a^,0^  + bj^o^ , Y^+Cj^a^ 5^  + **  *h“^  ’ 

the  vectors  8^  + bj^a.j , y^  + Cj^o^,...,  5^  + dj^a^  have  a rightmost 
coordinate  equal  to  0.  Thus,  these  vectors  have  a right  shift. 


Furthermore, 


•>1*^*1  • 


'*i*^h*t  • 


• ■'h-i‘^h‘h-1  • ” 


, ...  ,0 


0,  b^+bj^Sj,  ...  , b^^,+b^aj^^ 


h-1“h’h-1 


■ rank 


0,  d^+dj^a^ dj^.,+dj^a^_^ 


Define, 


«,  ^ [1,0,0,. ..,0], 


a row  vector  of  length  h.  Then 


dim  l>[a^ , 8^  ,Y  j , • • * , ] " dim  L[e^,(8'^^o)  ,(y^j^®)  , • • . , ] 


Each  state  has  at  least  one  primage.  If  - [s^  ,*2*  • • • »*h-l  ‘ 


1 1 . Stat*  Spaca 
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P 


Tq  ■ [®»*j *h-2**h-1^  **  * preimage  under  [x.y ,2, . . . ,t]  « [0,0,0,. .. ,0] 


If  • [*^  »*2»*  • • » then(t+a)  Is  a preimage  under  [x,y,z,. . . ,t]  ■ 


* [1 »0,0,. . . ,0] . But,  if  a state  Tj  has  a preimage  then  it  has  at  least 


2^  preimages,  i.e.  all  the  states  in  the  coset  of  L[e. , a)  , 

' " 0 


(y-Kva)  ,. . . ,(d*fd.  a)  ] that  contains  the  particular  pre image.  We  now 

0 "0 


have  the  following  results.  Each  state  has  exactly  2*^  images,  i.e. 
the  sink-tuple  of  . On  the  other  hand,  each  state  has  at  least  2*^ 


preimages,  i.e.  the  above  mentioned  coset  of  L[e. , (S-i^ua)  ,(r*^ha)  > 

' "0  "0 

...,(5-fd.a)  ].  Hence,  we  conclude  that  t.  has  exactly  preimages 
" 0 ' 


that  constitute  the  "source- tuple"  of  . It  is  easily  verified  that 
each  element  of  a source  tuple  has  the  same  sink-tuple. 


It  is  this  source/s  ink- tuple  description  of  the  state  space  that 


will  play  an  important  role  in  the  remainder  of  the  paper.  Hence,  to 


make  things  more  concrete,  we  give  a specific  example  for  the  syndrome 


former  of  Fig.  7- 


Fig.  7«  The  syndrome  former  for  a rate-i  convolutional  code. 


I 
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We  have 


-[1  1 0 - 13 

8,-Cl  0 0 1]2 


- [1  0 0 0]^  - 8 


- 9 


(a-i-B)  -[0010]. 

0 


Source**  tuples 
{0,  2,  8,10} 
{1,  3,  9,m 
{I*.  6,12,14} 
(5,  7,13,15} 


II 


III 


IV 


S I nk**  tuples 
{0,  4,  9,13} 
{2,  6,11,15} 
{1,  5,  8,12} 
{3,  7,10,14} 


Fig.  8 shoMS  a partition  of  the  state  space  in  source/s  I nk**  tuples, 

source* tuples 


sink- 

tuples 


1 

II 

IV 

1 1 1 

1 

0 

9 

13 

4 

II 

2 

11 

15 

6 

IV 

10 

3 

7 

14 

III 

8 

1 

5 

12 

Fig.  8.  State  space  partition  In  source/s  Ink- tuples. 


Kim 


m 


Anticipating  on  Section  IV  the  states  In  Fig.  8 have  been  geometrically 
arranged  in  such  a way  that  also  the  metric  equivalence  classes  {0}, 
.{4},  {8},  {12},  (9,13},  {6,14},  {1,5},  {2,10},  and  {3,7,11,15}  are 
easily  distinguishable.  Two  states  that  are  In  the  same  metric 
I equivalence  class  have  the  same  metric  value  [6],  irrespective  of  the 

I received  data  vector  sequence  £(X). 


W 
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III.  ALGORITHM 

Given  the  syndrome  sequence  u(X)  of  a rate*(n*1 )/n  code,  compare 
Fig.  4,  the  estimator  Is  to  determine  the  state  sequence  that  cor* 
responds  to  a noise  vector  sequence  estimate  ^(X)  of  minimum  Hamming 
weight  that  can  be  a possible  cause  of  u(X).  According  to  Section  II 
this  state  sequence  can  be  stored  in  terms  of  an  equivalent  message 
vector  sequence  correction  8^(X).  As  the  estimation  algorithm  to  be 
described  in  this  section  is  similar  to  Vlterbi's  [6],  we  can  be 
very  brief.  To  find  the  required  state  sequence  Vlterbi  introduces 
a "metric  function".  A metric  function  is  defined  as  a nonnegative 
integer-valued  function  on  the  states.  With  every  state  transition 
we  now  associate  the  Hamming  weight  of  its  noise  vector  [x,y,z, 

. . . , t]  . 

PROBLEM;  Given  a metric  function  f and  a syndrome  digit  u,  find 
a metric  function  g which  is  statewise  minimai,  and  for  every  state 
is  consistent  with  at  least  one  of  the  values  of  f on  its  preimages 
under  syndrome  digit  (o,  increased  by  the  weight  of  its  corresponding 


state  transition. 

The  solution  to  this  problem  expresses  g in  terms  of  f and  u,  and 
can  be  formulated  in  terms  of  the  source/s  ink- tuples  of  Section  II. 

In  fact,  the  values  of  g on  a sink-tuple  T^  are  completely  determined 
by  the  values  of  f on  the  corresponding  source-tuple  S.,  and  by  the 
syndrome  digit  u.  The  equations  that  express  g in  terms  of  f and  u 
are  called  "metric  equations".  They  have  the  form 

»y  t • • • , t] 

T ^ 

g(t^)  ■ min  {f(c^)  + W^([x,y  ,z, . . . ,t]  ) ( i ^ } 


f-  ^i3 


* *’  ‘ 


III.  Algorithm 


19. 


Th«  porticular  preimage  in  (4)  that  real izes  the  minimum  is  called 
the  "survivor".  When  there  are  more  preimages  for  which  the  minimum 
in  (4)  is  achieved,  one  could  flip  a multi'coin  to  determine  the  sur* 
vivor.  However,  we  will  shortly  discover  that  a judicious  choice  of 
the  survivor  among  the  candidate  preimages  offers  the  possibility  of 
significant  savings  in  decoder  hardware.  The  construction  of  (4)  can 
be  repeated,  i.e.  starting  with  a metric  function  f^,  given  a syndrome 
sequence  one  can  form  a sequence  of  metric  functions 

*3y  means  of  the  metric  equations: 


The  metric  function  f^,  whose  value  fj(cr^)at  an  arbitrary  state  , 
equals  the  Hamming  weight  of  the  lightest  path  from  the  zero**state 
to  0^  under  an  ail  zero  syndrome  sequence,  . .*0,0,0,. . . , 
is  called  the  "stable  metric  function".  It  has  the  property 


In  order  to  make  things  more  concrete  we  now  give  a specific 

example.  Fig.  9 represents  the  t-th  section,  t». . . ,-1 ,0,+1 

of  the  trellis  diagram  [6]  corresponding  to  the  state  diagram  of 
Fig.  5.  From  Fig.  9 we  find  for  the  metric  equations: 


g(0)-iil  min[f(0),f(l)+2,f(2)+1,f(3)+3]-H-  min[f (0)+1  ,f (l)+3,f  (2)  ,f  (3)+2] 
g(l)-i  min[f(0)+2.f(l)+2,f(2)+1,f(3)+l]+w  min[f (0)+1  ,f (1)+1  ,f (2)+2,f (3)+2] 
g(2)-i  min[f(0)+2,f(l),f(2)+3,f(3)+l]+«  min[f (0)+3,f (D+l  ,f (2)+2,f (3)] 
9(3)-^  min[f{0)+2,f(l)+2,f(2)+l,f(3)+l]+a)  min(f  (0)+I  ,f  (1)+1  ,f  (2)+2,f  (3)+2] 

^ 


(5a) 

Iv"’ 

(5b) 

(5c) 
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current  value  t*. . . ,~1 ,0,4>1 , . . . , of  the  metric  function. 

As  only  the  differences  between  the  values  of  the  metric  function 
matter  in  the  decoding  algorithm 

min  {f^[T,  (J)]} 

0sj<3 


is  subtracted  from  the  contents  of  all  metric  registers,  thus  bounding 
the  value  of  the  contents  of  the  metric  registers.  The  path  register 
PRj  stores  the  sequence  of  survivors  leading  up  to  state  T^(j)  at  time  t. 
The  survivor  sequence  is  stored  in  terms  of  the  associated  message 

v.ctor  corrections  »ek,t-1>  ' '*«.!, t ‘..k.t'  ‘ 

ta. . . ,**1 ,0  ,<i’1 , . . . . Observe  that  all  quantities  that  are  crucial  to 
the  estimation  algorithm  that  determines  5 (X)  given  u(X)  are  contained 
in  the  trellis  section  of  Fig.  9. 

Now  observe  that  (5b)  and  (5d)  are  identical.  Hence,  the  states 
T^(l)  and  t^(3)  have  identical  metric  register  contents.  Moreover, 
selecting  the  identical  survivor  in  case  of  a tie,  t^(1)  and  t^(3) 
also  have  the  same  path  register  contents.  As  far  as  metric  register 
and  path  register  contents  are  concerned,  the  states  t^(1)  and  T|(3) 
are  not  distinct.  The  metric  register  and  the  path  register  of  either 
state  T.|(l)  or  state  t^(3)  can  be  eliminated.  Apparently,  certain 
symmetries  In  the  state  space  of  the  syndrome  former  can  be  exploited 
to  reduce  the  amount  of  decoder  hardware!  In  the  next  two  sections  we 


III.  Algorithm 


For  furthor  details  on  the  Implementation  of  the  syndrome  decoder 
one  is  referred  to  [3].  In  this  same  paper  SchalkMiJk  and  Vi  nek  also 
suggest  a slightly  modified  decoder  implementation  that  uses  a read 
only  memory  (ROH)  thus  eliminating  the  need  for  metric  registers  al- 
together . 


IV.  SPECIAL  R»(n~l)/n  COOES-METR I C/PATH  REGISTER  SAVINGS 


Without  further  ado  we  now  introduce  the  class  r i.  . of  rate-(n-1)/n 

0 f M 

binary  convolutional  codes  (A,B,C,. . . ,0) , i.e.  in  terms  of  their 
syndroaw  formers,  that  exhibits  state  space  synmetries  that  allow  for 
an  exponential  reduction  of  decoder  hardware.  To  wit  (A,B,C,...,0) 

« ^.h.t 


•j,  - t (6a) 

•j  ■ bj  ; 0<j#l-i  (6b) 

aj  ■ bj  ; h-l+isjih  (6c) 

C,...,0  all  have  degree  (6d) 

gcd(A,B,C,...,0)  ■ 1 (6e) 

j f (®^)q  tYg  » • • • D L[  (o+B)  j , . . . , (o+S)  j ] ■ (6f) 


Note  that  the  code  A(X)  - l+X+X^  , B(X)  ■ 1+X^  , C(X)  - 1 of  Fig.  2 is 
an  oleaMnt  of  Tj  The  code  A(X)  - UX+X^+X**  , B(X)  - l+X+X**  of 
Pig.  7 is  an  element  of  T2  ^ 2*  * consequence  of  (6)  we  have 

^n,h,i  = ^n,h,2  =*  ^n,h,3  ^ ***  * 

If  condition  (6e)  is  satisfied,  then  It  follows  from  the  invariant 

factor  theorem  [if]  that  the  n-tuple  (A,8,C 0)  is  a set  of  syndrome 

polynomials  for  some  non-catas trophic  rate*(n-l)/n  convolutional 
code  (In  fact,  for  a class  of  such  codes). 


Assume  T w , i*  For  (A,B,C, . . . ,D)  € T t,  . •»'  '*l*singleton 

n,n,t 

state"  is  defined  to  be  a state  the  last  1 components  of  which  vanish. 
Linear  combinations  and  left  shifts  of  t-singieton  states  are  l~singleton 
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states,  too.  For  every  state  the  states  are  i*sing1eton 

states.  Vfe  have  the  following  Ismma,  the  proof  of  which  Is  left  to  the 
reader. 

LEHHA  1;  For  every  state  there  exists  a unique  i-singleton  state 
and  a unique  index  set  I<=  {1,2,...,i}  such  that 

5 ■ o.  - + £ o,  . (8) 

I ^ lei  ’ 

i Using  this  lenana  we  now  associate  with  the  state  the  set 

defined  by 


to,]'*’  - C*I 


£ [a,+r,(o+S) ,] |r,  e {0,1}  for  ail  i> 

lei  ‘ ' ' ' 


We  shall  prove  the  following  theorem: 

THEOREM  2:  The  collection  of  all  sets  [0|] forms  a partition  of 
the  state  space. 

PROOF;  Obviously  the  union  of  all  Is  equal  to  the  state 

space.  So,  we  only  have  to  prove  that  whenever 

n yi  #.  Let  us  assume  that  n i*  ♦. 

Then  there  exist  r^  and  s^  such  that 


*1*1  * ^ f*i  **■  . 

t+l  ,^j,  I I I 


♦l>1  “ ^ rAa*6).  - £ *,(a+B),  - £ a,  . 

l-H  I • 1,1*  ' ‘ ' 
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Nom  tha  LSH  of  above  equation  is  an  t-singleton  state  by  (6b, c)  so  that 
the  symnetric  difference  lAI’  must  be  empty,  in  other  words  I«I*. 
Therefore  we  get 

♦i-H  • ♦£+!  " (r,-s,)(a+6)j  , 

^i+1  ^tfl  SO"**  linear  combination  of  ((a-fd)  I ( i<I}  . 

But  then  we  must  have  since  in  the  construction 

of  these  classes  all  linear  combinations  of  ( (a-fB) . | iel}  are  involved. 

a.E.o. 


COROLLARY ; Based  on  the  partition  of  the  state  space  according  to 

Theorem  2 an  equivalence  relation  R . . can  be  defined,  where  two 

n,h,t 

states  o^  and  o|  are  called  R^  ^'equivalent  iff 


The  one-element  equivalence  classes  of  R . . consists  of  exactly  one 

n,n,i 

i-singleton  state.  An  example  are  the  states  0,4,8  and  12  in  Fig.  8. 

The  number  N . of  R . .-equivalence  classes  can  be  found  as 

follows.  First,  take  I <=  {1 ,2,.. . ,1}  in  (8)  fixed,  and  let  J denote 

the  cardinality  of  I.  The  last  I components  of  an  1-singleton  state 

are  zero.  Hence,  there  are  2^  ^ 1-sIngleton  states.  Now  2^^  of  these 

2^  ^ l-sIng1eton  states  correspond  to  the  same  R . .-equivalence 

n j n p * 

class,  I. a.  all  1-slngleton  states  differing  by  a linear  combination 

of  ( (a-*^)  1 1 i el)  . Henca  there  are  2^  ^ R . .-equivalence  classes 
I ' n ,n 

for  each  X of  cardinality  J.  Thus 


0,n,l  j 
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THEOREM  3:  Let  (A,B,C,. . . ,0)  € F_  ^ , and  assune  that  Ul'st. 

- — n,Ht* 


Then  every  . .-equivalence  class  of  (A,B,C,... ,0)  Is  a union  of 
n yfi  9 X 


R.  k . t-equi valence  classes  of  (A,B,C,...,0>,  cf  (7). 
n,n,i 

PROOF:  Let  o.  and  Xi  be  R_  ^ ..-equivalent  states  of  (A,B,C,...»0) 

******^^*  1 I M y O ^ Jv 

Then  we  may  write  for  some  r^  e {0,1},  I c I*  c {1 ,2,. . . ,1*}  : 


“ ♦r+l  + 2 “l  • 


On  the  other  hand,  for  some  I"  c{l*+I . ,A}  and  some  T.  , we  have 


♦f.i  - ’t.i  * • 


Letting  I ■ I*  U T*,  Tj-0  for  IfV’we  now  obtair 


»,  - V,  * *. 


* ***'  * ui 


I. a.  and  are  R^  ^ ^-equivalent 


Q.E.O. 


In  Fig.  8 we  exhibit  the  R2  4 2 classes  for  the 


A(X)  ■ , B(X)  ■ i-t>X<t>X^  code.  We  claimed  that  any  two  states 


within  the  same  equivalence  class  have  the  same  metric  value  ir- 


respective of  the  received  data  vector  sequence  £(X) . We  are  now 


ready  to  prove  this  result. 


' V 


k 


k 


i 
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I 


THEOREM  4;  Assume  that  (A,B,C C)  c Let  fg  be  any 

starting  metric  function,  and  let  U2>  be  any  syndrome 

sequence.  Then  every  Iterate  f^  Is  constant  on  the  R^  ^ ^~equ I valence 
classes  of  (A,B,C,. . . ,0) , Isusl. 

PROOF;  The  proof  Is  by  Induction  on  u.  Consider  the  two  R^^  ^ 
equivalent  states  they  belong  to  the 

same  slnk'tuple.  We  list  their  prelmages,  corresponding  noise  vectors 
and  syndrome  digits  according  to  (3) • 


Preimage 

Noise; Syndrome 

♦l 

[1 ,0 ,z, . . . , t]  ;u^ 

♦ ^ +(0+6)g+ZYg+...+t«g 

[0 ,1  ,z, . . . ,t]  ;ui^ 

♦l**l  **irg*...««g 

[1 ,0,z,. .. ,t]  ;u^ 

♦ ^♦e^-t.(04«)g+Zirg+.  . .’►tBg 

[0,1  ,z t]^;u^ 

♦Z*8| 


Noise; Syndrome 


We  see  that  on  every  line,  i.e.  for  every  preimage  the  syndrome  bits 

and  the  Hamming  weights  of  the  state  transitions  to  ^2*^1'  ^2*^1 

are  identical.  Hence,  ■ f^(#2'*^^)  fo>*  *very  fg  and  every 

u^.  This  proves  the  assertion  for  u«1.  Now  let  us  assusie  that  the 

statament  is  true  for  a fixed  u,  lauai-l.  Let  fg  be  any  starting  metric 

function  and  let  ,ii»2 • • • • *ny  syndroM  sequence.  Then,  by  our 

Induction  hypothesis,  f,.  Is  constant  on  the  R . -equivalence  classes. 

u 

Let  and  x{  be  any  pair  of  R^  ^ ^-equ I valent  states.  Then  there  Is 
a state  and  an  Index  set  X c{1,2,...,u)  such  that  for  some 
r,  f {0,1} 


.. 

I 

. I » 


r 


*i  • -I  > 

ML 


^1  “ ''u+l  [a,+r.(a+6)jl 


O o 


<■.  r. 
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We  noM  consider  the  cosets  S and  S'  of  L[ep(a+6)Q,Ygf  • • t^g]  to 
Mhich  X|  *'^<1  x{  belong,  respectively,  and  compare  them  element  wise. 
The  states 


X|  + P*t  ”►  q(a+6)g  ryg  + 


. ♦ S«g, 


and 


Xj  + pe^  + q(o+e)g  + ryg  + ...  + 


56. 


are  obviously  R . -equivalent  for.  all  p.q. r,...,s  e {0,1},  since 
by  the  definition  of  and  by  (6c, d)  the  last  u components  of 
pe^  ♦ q(a'H6)g  + ryg  + ...  + s6g  vanish.  Furthermore,  by  (6b)  we  have 


E a,  - E (a,+r,(a.+b,)] 
i£l  ‘ i«I  ‘ ‘ 


Hence,  by  (3)  the  pre images 


X^  + pc^  + q(«+8)g  + ryg  + ...  + s6g. 


and 


X{  + pc^  + q(a+6)g  + ryg  + . . . + 


s6. 


give  rise  to  identical  syndrome  digits  in  response  to  an  input 
vector  [x,y,z,. . . ,t]^.  These  arguments  together,  however,  Imply 
that  the  values  of  on  the  corresponding  state  transition  images 
are  equal  and,  hence,  f^^^  is  constant  on  the  R^  -equivalence 
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classes  of  (A,B,C,. . . ,D) . Q.E.O. 

Thaorm  4 proves  that  one  needs  oniy  one  metric  register  for  each 
h class.  Wa  will  now  show  that,  except  for  the  last 

i*1  stages,  the  sane  is  true  for  the  path  registers.  Let  (A,B,C,. . . ,0) 
e Condition  (6f ) , where  {(o+B),  ,(<m-B)2,...,(*»'6)£.^  > ■ 

fort>1.  Implies  that  a coset  of  L[ep(a>6)Q,YQ,...,5g]  and  a coset 
of  L[(eH»B)^  .(o+B)^,...  ,(flt+B)j^_^l  can  have  at  most  one  element  in 
common,  i.e. 

LEMMA  5;  No  two  distinct  R^^  -equivalent  states  can  belong  to 
the  same  source  tuple. 

On  the  other  hand,  from  the  proof  of  Theorem  4 it  follows  that  when- 
ever and  Xf  are  R^  ^ -equivalent,  then  the  same  holds  for  the 
states 


X^  + pe^  ♦ q(a-i4)Q  + ryg  + . . . + sd^  , 


X|  ♦ pe^  q(a<t^)g  + ry^  ♦ ...  + s«q  , s c {0,1}  , 

that  form  the  source- tuples  containing  and  X|.  These  results  lead 
to  a natural  equivalence  between  source-tuples.  T«<o  source-tuples  are 
said  to  be  equivalent  If  they  contain  a pair  of  R^  ^ ^,^-equivalent 
states.  It  is  left  to  the  reader  to  prove  that  this  relation  is  an 
equivalence  relation.  The  unique  and  natural  one-to-one  correspondence 
between  the  states  of  two  equivalent  source-tuples,  that  is  Induced  by 
the  intersection  with  R^  -equivalence  classes  is,  by  the  proof 
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of  Theorem  4,  consistent  with  the  algebraic  difference  structure  of 

the  source- tuples.  Hence,  In  view  of  Theorem  4,  we  see  that  for  the 

m-th  iterate  f , m>l-l,  of  any  metric  function  f^  under  any  syndrome 
m V 

sequence  .Uj .“3 » • • • values  of  f^^^  on  the  corresponding  states 

of  two  equivalent  source-tuples  are  identical. 


Given  two  successive  iterates  fj,^  and  fj,  of  a metric 
function  fg,  linked  by  the  syndrome  digit  Wj, 


u. 


In  Viterbi  decoding  [6]  one  determines  for  each  state  a survivor 
such  that 


fj(x^)  * ^ ( [x ,y  ,z , . . . , t]  ) , 


subject  to  (4).  Survivors  of  a state  x^  in  the  sink-tupie  T.  always 
belong  to  the  corresponding  source-tuple  Sj,  see  Section  N.  However, 
as  discussed  in  Section  III,  there  are  situations  in  which  more  than 
one  survivor  may  be  chosen,  i.e.  when  two  or  more  o^'s  in  (4)  achieve 
the  minimum.  In  this  case,  one  has  a choice  of  two  possible  strategies 
that  result  In  the  same  decoded  error  rate  by  transmission  over  a 
binary  symmetric  channel  (BSC),  I.e.  (i)  flip  a (multi)  coin,  or 
(ii)  decide  for  every  tie-pattern  once  and  for  ever  which  survivor 
shall  be  taken.  We  shall  use  the  second  strategy,  that  according  to 
the  properties  of  equivalent  source-tuples  can  be  realized  in  the 
following  way:  Whenever  two  source-tuples  S|  and  S|  are  equivalent 
(and,  hence,  have  statewise  identical  fj_^-values)  then  let  for  the 
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respective  sink-tuples  Tj  and  T|  statewise  corresponding  survivors 

be  chosen  In  such  a way,  that  R . .-equivalent  states  get  the  same 

n gfl  9 1 

survivor.  Given  a sequence  of  metric  function  iterates 


“2 


(di 


f. 

J*1 


fj  f ji®"  • 


then  for  every  state  a sequence  of  successive  survivors  can  be 
constructed 

a H)  (-j+1)  (-j+2)  ^ ^ (-2)  (-’) 

and  the  following  theorem  holds. 

THEOREM  5:  If  a.  and  n.  are  distinct  R _-eauivaIent  states 

“ ■ I I ngn^in 

then  ^ • m«I,2,...,t  . 

PROOF ; The  proof  is  by  Induction  on  m.  For  ma1  the  assertion  is 

part  of  our  assumption  above.  Now  assume  that  the  statement  is  true 

for  n»«wi,  u fixed,  1SuSi-1  , and  let  and  be  two  R^ 

equi valent  states,  that  are  not  R . -equivalent  (otherwise  o. 

n pn  p(i  I 

("«)  u , - (-U-1)  _ _ (-U-1) 


(-u) 
) . Then  we  may 


■ and,  hence,  immediateiy  o^ 

write 


“ *u+2  ®u+1  * ®i 

Ifl 


where  I c {1,2,... ,u}  . It  is  easy  to  find  preimages  and  of 
and  respectively,  viz. 
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o,  ■ ♦ . , + o + Z a.  , , 


1 -Vl  ♦ “u  * 


Obviously,  o,  and  n,  are  R . -equivalent  and,  hence,  by  Theorem  3> 
1 I n yU 

also  R . .-equivalent.  Therefore,  the  source-tuples  containing 

n gll  I 

and  are  equivalent.  Furthermore,  we  observe  that 


•\t 

•^1  • ^2  * 


if  i/I 


if  ifl 


h2  + 


if  \n 


o^+r^(o+e)^  If  ifl 


Hence,  because  of  the  assumption  made  above,  the  survivors  a 


(-1) 


(-1) 


and  n,  are  corresponding  states,  i.e.  R . .-equivalent  states. 
I n fX*  I 

The  algebraic  difference  structure  of  equivalent  source-tuples  is 
identical,  hence. 


a,  - o 


(-1) 


(-1) 


1 ''1 


9 »Yq  » • • • >^q] 


So,  O^  - Oy 


^ - n 

'’l  '’l 


(-1) 


^ is  a u-singleton  state.  Hence, 


and  are  R^  ^-equivalent  and  therefore,  by  the  induction 

hypothesis,  O.E.D. 


Theorem  5 shows  that  except  perhaps  for  the  last  i-1  stages, 

R^,h  equivalent  states  have  the  same  path  register  contents 
irrespective  of  the  received  data  vector  sequence  r^(X) . Thus,  roughly 
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4 


m 


speaking,  one  needs  oniy  one  path  register  for  each  R . >equiva^ence 

n pn  g 

class  of  states.  By  Theorem  k one  only  needs  one  metric  register  per 

R_  . .'equivalence  class.  Hence,  the  complexity  [3]  of  a syndrome 
n pH  pJL 

decoder  for  a code  (A,B,C,. . . ,0)  e , Is  proportional  to  the 

number  ^ ^ h ^^-equ  I valence  classes,  I.e.  by  (9)  the  complex* 

ity  is  proportional  to  2 3 . As  an  example  take  a code  in  T2  2l,V 

i.e.  a rate-i  code  with 

A(X)  - + ...  + A^X  + 1 , 

B(X)  • A(X)  + X^  . 


The  syndrome  decoder  for  such  a coda  has  complexity  proportional  to 
3^  - (»^^.  The  classical  ViterbI  decoder  [6]  for  the  same  code  has 
complexity  2^,  hence,  by  exploiting  the  state  space  symmetry  we 
achieve  an  exponential  saving  in  hardware. 


Before  extending  our  present  results  to  rate-k/n  codes  one  comment 

concerning  the  free  distance  of  codes  (A,B,C D)  e u . Is  in 

order.  It  Is  quite  obvious  that  constraints  like  (6)  can  reduce  the 

maximum  obtainable  free  distance  for  given  n,  and  h.  We  are  not  yet 

able  to  derive  a lower  bound  on  the  free  distance  of  codes  (A,B,C,...0) 

f h 1*  However,  Table  I of  the  next  section  lists  the  free  distance 

of  some  short  constraint  length  codes  in  T ^ it  turns  out  that 

n ,n , s 

at  least  for  these  constraint  lengths  the  free  distance  for  the  codes 
satisfying  the  constraints  (6)  is  very  close  to  the  maximum  achievable 
free  distance  for  the  given  values  of  n,  and  h. 
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The  syndrome  former  of  a rate-k/n  convolutional  code  consists  of 
n-k  syndrome  formers  of  the  type  considered  in  Section  II,  all  sharing 
the  same  set  of  nh  memory  cells,  compare  Fig.  k.  Hence,  the  n*k 
syndrome  formers  in  the  set  , where  > (Aj,Bj,C|, 

...,0|),  ail  have  the  same  physicai  state,  i.e.  the  contents  of  the 
nh  memory  ceils  they  have  in  common.  To  obtain  the  metric/path  register 
savings  that  were  realized  in  Section  IV  each  of  the  syndrome  formers 
l',  I«1 ,2,. . . ,n-k  , should  be  in  r_  . , , and  the  common  physical 
states  should  have  the  same  equivalence  classes  w.r.t.  the  equivalence 
relation  of  syndrome-indistinguishabil ity  in  each  of  the  n**k  individuai 
syndrome  formers.  We  will  call  a set  of  rate-(n-1)/n  syndrome  formers 
that  share  a common  physical  state  "coherent"  if  the  individual 
syndrome  formers  have  the  same  abstract  states. 

(n-k) 

Let  , be  the  class  of  codes  that  are  defined  by  n-k  coherent 
n,h,i 

syndrome  formers  each  of  whichi  is  in  T . ..  Table  I lists  the 

n,n,A_ 

maximum  free  distance  for  various  values  of  the  parameters  k,n,h,  and  £. 

The  classes  with  (k,n)  ■ (1,3)  are  defined  by  two  coherent 

syndrome  formers.  The  column  with  "N"  on  top  gives  the  maximum  free 

distance  for  the  relevant  values  of  k,n,andh  dropping  the  coherence 

requirement.  Comparing  the  N-column  with  the  l"1-column  both  for  (k,n)  • 

* (1,3)  gives  some  idea  of  the  effect  of  the  coherence  requirement  on 

(n-k) 

the  free  distance.  Table  II  lists  several  optimal  F.  codes  in 
terms  of  their  syndrome  former  connections,  geometrically  arranged 


(k,n)  - (2,3) 


(k,n) 
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Tha  ramaindar  of  this  saction  will  ba  davotad  to  a study  of  tha 
nawiy  dafinad  concapt  of  coharanca  of  syndrona  fornars.  Considar 
two  syndrona  formars 

E - (A,B,C,...,D)  , 
and 

E*  k (A'.B'.C* D') 

sharing  tha  saaw  sat  of  nh  memory  calls,  compara  Fig.  k.  From  tha 
raathamatical  point  of  view  the  syndroma-indistinguishabi I i ty  classas 
of  a syndroma  formar  E can  be  considered  as  cosats  of  tha  sat  of 
those  physical  states  that  have  an  all  zero  syndroma  sequence  in 
response  to  a sequence  of  ail  zero  noise  vectors.  Hence,  wa  may 
state  that  E and  E'  are  coherent  if  and  only  if  for  all  nh~tuples 


(x^ , . . . ,Xj^jy  ^ • ...jt^,... 


wa  have 


^*l®h+1-l  '^^i^h+l-i  •••  * *i^h+l-i^ 


jJ,  ^*l®h-M-l  * yi®h+l-l  •••  ■**  *i*h+l-i^  "5.  • 


Wa  shall  now  discuss  soma  consequences  of  this  concept  of  coherence. 
1/  Let  £ and  E*  ba  coherent  syndrome  formers,  and  assume  as  before 
that  a^  ■ 1.  Then  {a^ ,02> • • • is  a basis  for  the  abstract  state 
space  of  £.  In  other  words 
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*iVi-i  - » — -S.-0 


SO  that  by  coharanca 


m 


Hanca,  (a{,a2....*o^}  is  a basis  for  tha  abstract  stata  spaca  of  £* 

*i:  • 

2/  Lat  Z and  Z*  ba  coharant  syndrosM  fonsars , *|y  * ^ * 

Than  tha  corraspondanea 


I 

I 


h h 

ffl  * “*  * *i*h+l-i^  ^ jf,  ^*i®h+l-i  * *••  * *i*h+l-i^ 


is  an  isosnrphism  batwaan  tha  abstract  stata  spacas  of  Z and  Z’. 

SKETCH  OF  PROOF;  By  1/,  {o^  ,Oj,. . . .Oj^}  and  {o| . ,o^}  ara 
basas  of  tha  stata  spacas  abova.  Hanca,  for  axaapia 


IS:.; 


■W. 

1: 

k 


“l  ■ “1*1  * “2*2  * •••  ♦ “l.^ 


m 


-•l  ♦ “1*1  ♦ “2*2  ♦ - 1 . 


SO  that  by  coharanca 


-0^  u^o^’  ♦ UjO^  ♦ • • • ♦ Uj^O^  • 2, 


• u^a^'  + U2<»2  , etc. 


§ 
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3/  Lat  I and  S*  ba  coharant  syndrosM  fonsars,  I .a.  a^^  « a^  ■ 1 . 

Than  £ and  z*  hava  Isasorphic  sourca/slnk~tupla  structuras. 

PROOF:  SInk-tuplas  In  tha  stata  spaca  of  t ara  eosats  of 

L[oi|»S|»y|f**fd|](  and  this  subspaca  eorrasponds  by  2/»  In  tha 

obvious  May.  by  coharanca,  to  L[a{«S|tY{ • Sourca-tuplas 

In  tha  stata  spaca  of  Z ara  cosats  of  tha  sat  S of  thosa  abstract 

A ^ 

statas  that  hava  imaga  0 undar  stats  transition.  Lat  o.  ■ Z 'u.a, 

' 1-1  ' ' 

such  that  undar  stata  transition  with  tha  noisa  vector 

[x,y,z,...,t]^.  Than  wa  hava 


h-1 

Z + t6^  ■ i » 


so  that  by  coherenca 


h-1 


£ UjO|^^  + xoj  ♦ y6{  rr{  •►  ...  ♦ t«{  • 01  , 


1-1 


which  naans  that  In  tha  stata  spaca  of  £*,  whan  wa  define  o!  ■ 

A •» 

> Z u.a!  • also  o!  K 0 undar  stata  transition  with  noisa  vector 
I-l  ' ' , * ” 

[x»y*z,...»tj  » and  vice  versa.  Hanca,  eoharanca  Inplias  that  both 


L[o^  »S^  fY| » . • . 1 »Y| f • • • 


and 


$4^$' 


by  the  Isonorphisn  defined  In  2/.  This  Implies  that  also  tha  cosats 
of  L£oi^  9R^iY^f...90^]  and  S • and  tha  cosats  of  L£o|  *^1  **  * * ^^1^ 
and  S'  hava  Isomorphic  Intersections.  (^.E.O. 
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k/  Finally,  wa  can  rastata  tha  coharanca  of  Z and  £*  in  tarms  of  a 
condition  of  thair  polynoalals  , and 

as  folloMS.  Lat  £ and  £'  ba  coharant  syndroma  formars,  a^^  ■ aj^  <■  1. 
Lat  tha  isanorphisn  batwaan  thair  stata  spacas,  which  is  ganaratad 
by  tha  mapping  Oj  oj  , J * h,h-1,...,1  , w.r.t.  tha  natural  basis 
of  unit  vactors  ba  givan  by  tha  (Invartlbia)  matrix  (I,  i.a. 


1 

0 

0 

0 

1 

0 

0 

0 

Vi 

1 

0 

0 

m 

•h-1 

1 

0 . 

0 

e 

• 

# e 

e 

• 

• 

• • 

• 

•l 

• 

*2 

*3  • 

1 

*2 

*3  • 

1 

It  is  immadlately  vartflad  that  Q itself  has  the  form 


a- 


1 0 0 
Vi  ' 0 


0 

0 


**2  ^ 


Tha  isomorphism  also  entails  that 


Ci  *')  ( 1 *') 


x')  3 b^.j  x’(mod  X*')  , etc. 


i-0 
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Tha  SMtrix  idantity  (10)  can  ba  raformulatad  as  a polynomial 
congruanca,  i.a. 

Ci  *')  ("i!  *"->  *')  * *h-i 


i'i 

P 


Vi*.  \ ^ 
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h-1 

Elimination  of  Z q X yields 
i-0 

(S  (S 

3 0 (mod  X*')  . 


h-1 
£ a, 
1-0 


h-i 


)(S 


Ravarsing  the  order  of  the  coefficients  in  the  polynomials  of 
this  congruence  we  find 


‘‘*®"**  liio 


h-1 


,l 


h-1 


h-1 


E b,^,X-  - I 


1-0 


....  . 
a X'  E b*  x' 
I-O  i-0 


C h-2  , 


or 


dagraa  (A»(X)S(X)  - B»{X)A(X)]  s h,  ate. 

in  fact,  this  reasoning  can  also  be  given  in  the  opposite 
direction,  Mhere  we  construct,  given  - «^  - 1,  the  polynomial 
$(X)  and,  hence,  the  transformation  Q as 


‘(s  a • 


h-1 

Note  that  ah  - 1 and,  hence,  the  polynomial  £ a.  ,X  Is 
invertible  mod  x"  . So  we  have  the  following  theorem. 

THEOREM  6:  Two  syndrome  formers  £ ^ (A,B,C, . . . ,0)  and  £*^ 
A(A*,B’,C*,...,0*), where  h - h’,  are  coherent  If  and  only  If  all 
2x2  subdeterminants  of  the  polynomial  matrix 


r. 

k « 


V 


V.  Special  R«k/n  codes-matr I c/path  ragistar  savings 


I 

i 

i 

I 

r 

f 


IA(X)  B(X)  C(X)  . . . 0(X) 

A’(X)  B*(X)  C’(X)  . . . 0*(X) 

have  dagraa  a h. 


Wa  concluda  this  section  with  an  example.  Consider  the  binary 

rate~1/3  convolutional  code  generated  by  an  encoder  with  connection 

polynomials  1+X^+X^+X^  , i+X^+X^+X^+X^  , and  X^+xVx^+x^  . The  inverse 

encoder  of  minimal  degree  is  unique,  and  is  given  by  the  polynomials  i-**X-i>X^, 
2 

X,  and  X . The  free  distance  of  the  above  code  is  13  (the  maximum  free 

distance  for  a rate*1/3  code  with  polynomials  of  degree  6 is  IS).  A 

set  of  syndrome  formers  of  minimal  degree  Is  given  by  1*»-X-i>X^  , 1-i>X  , 

X*t>X^  I and  X^  , X^<^X^  , 1<fX<fX^  . The  imp  lamentation  of  a decoder 

using  this  particular  set  of  syndrome  formers  requires  2^  « 6A  metric/ 

path  register  combinations.  The  set  of  syndrome  formers  1-fX^-t*X^  , 

1+X^  , l+X+x\x^  , and  1+X+X^+xVx^+X^  , 1+X+X^+X^  , X^+X^+X^  is 

coherent,  but  a decoder  using  this  particular  set  of  syndrome  formers 

also  requires  2^  ■ 6k  metric/path  register  combinations.  The  set  of 

syndrome  formers  1+X+X^  , 1+X+xVx^  , 1+X+X^+X^  , and  1+X^+X^>X^  , 

l+X^+X^+X^+X^+X^  , X'4J(^'fX^  is  coherent  and  Is  a subsat  of  r,  ^ « 

3»o,z 

and,  hence,  our  code  belongs  to  ^ 2 therefore,  by  (9)  the 
corresponding  decoder  can  be  implemented  with  N.  ^ ■ 36  metr I c/path 

register  combinations! 
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This  paper  describes  the  operation  of  a syndrome  decoder  for 


binary  rate*k/n  convolutional  codes  in  terms  of  the  state  space 


(n-lc) 

of  its  syndrosM  former.  A class  F'  h.  • of  convolutional  codes  is 

n^nfXr 

defined  that  exhibits  certain  state  space  symmetries  that  allow 

for  an  exponential  reduction  of  decoder  hardware.  The  maximum  free 

! (n-k) 

distance  of  several  short  constraint  length  F^  . classes  is 
< n,n , Xi 

I listed  in  Table  I.  Codes  achieving  the  maximum  free  distance  of 

I several  classes  are  given  In  Table  II.  These  F 

I n,2i>i  ’ n,2l,t 

* classes  offer  the  largest  hardware  savings! 

i 

[Presently,  we  are  investigating  whether  the  state  space  formalism 
developed  in  this  paper  can  also  be  used  to  advantage  in  sequential 
decoding.  It  will  then  become  interesting  to  find  the  maximum  free 
distance  of  classes  of  long  constraint  length  codes  that  exhibit 
certain  state  space  symmetries.  This  is  one  of  our  present  topics 
of  research. 
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3.0  SOFT  DECISION  SYNDROME  DECCTJING 

Abstract 

A method  Is  given  for  soft  decision  syndrome  decoding. 

Then  the  influence  of  soft  decision  on  the  hardware  complexity 
will  be  discussed. 
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1.  PITHODOCTION 


of  "Vitotbi  lipJcs"  syndcone  decoding  fov  biiiAry  con~ 
volutional  codas  will  bs  explained  using  the  R-»i  binary  code  gene- 
rated by  the  encoder  of  Figr,  2, 


*(•*)*  C2(<>)n^(» ) 


te 


encoder 


pi 

J £ 

m 


channel 


syndrome  former 


Fig,  1.  Encoding  and  syndrome  forming  circuit  for 
a Rslf  code 


The  encoder  has  connection  polynomials  (a)  and  CjCo).  Hence,  the 
•**coder  outputs  are  C^(a)x(a)  and  C2(a)x(a)«  The  syndrome  z(o)  only 
depends  on  n^Ca)  amd  n^Ca),  for 

*(o)  - CjCo)  [Cj(a)x(a)  +n^(o)]  + (o)  [C2(o)x(o)  +n2(o)] 

■ C2(a)n^(o)  + Cj(o)n2(a) 

For  a non  catastro^lc  code,  (a)  and  €2(0)  are  relatively  prime. 
Hence,  there  exist  polynomials  Dj^  (a)  and  02(0)  such  that 

Dj(o)C^(a)  + 02(0)02(0)  - 1.  The  estimate  *(o)  of  the  data  sequence 
x(o)  can  be  written  as 


rCf  • ."v.T  Z V ▼ ».j^_*j*  « 


*(o)  ■ [D^(o)yj^(a)  + D2(o)y2(a)]  ■*•  0(a) 


whara 


0(a)  • Oj(a)ilj(a)  O^lay&^ia) 


y^(o)  ■ C^(a)x(a)  + n^(a)  ; 1 ■ 1,2 


According  to  [1],  wa  can  draw  tha  stata  diagram,  saa  Fig,  2,  for  tha 
syndroma  forming  clrctilt  of  Pig.  1.  Solid  transitions 


i 


Fig,  2,  State  diagram  of  the  syndrome  former 
In  Pig.  2 corraspond  to  Zj^  - 0,  and  dashad  transitions  to  - 1, 

]c  a •••,-1,0, !,•••.  Naxt  to  aach  transition  ona  finds  the  values  of 
*Sel'  ^ “ •••»“l»0, !,••••  With  aach  state  in  Fig.  2i  wa 

associate  a metric  register,  and  a path  register.  The  metric  register 
contains  tha  logarithm  of  tha  path  likelihood  of  the  most  llkell  path 
entering  a particular  state  s^  (k) , j ■ 0,1,  •••  ,2''“^  at  the  particular 
time  k,  k > •••,-1,0,1, •••.  The  logarithm  of  the  likelihood  is  taken. 


for  then  tha  new  metric  at  time  k-t-1  la  the  sum  of  the  old  metric  at 


time  k and  the  branch  metric.  The  coefficients  u,^ 


j - j ...  • j 

k-D+1'  “k-D+2'  ' “k 


0 


3c  - ...,-1,0,1,  •••,  usociatsd  with  thw  path  of 

maximum  log  llkollhood  ara  storad  In  tha  path  raglstar  for  tha 
j-th  stata.  Tha  oldest  bit  on  tha  path  with  largest  metric 


is  added  to 

[Dj(o)y^(a)  D2(o)y2(o)]j^_jj^j 

to  give  the  astimata  It  (a)  of  (2). 


Qamnzjvrioii  of  the  hbciivep  c<»e  symbols 


As  pointed  out  in  [2],  180*  binary  phase  shift  keying  (BPSK)  in 


coBtbination  with  coding  is  an  efficient  way  of  conminication  over 
Gaussian  channels.  Quantization  of  the  demodulated  received  code 
symbols,  is  to  facilitate  digital  processing  at  the  decoder.  When 
8-level  quantization  is  used,  about  0.2S  dB  in  received  signal  to 
noise  ratio  is  lost,  compared  with  infinitely  fine  quantization. 
Bence,  further  quantization  is  questionable.  With  2-level  (binary) 
quantization  the  loss  in  SMR  is  roughly  2 dB.  Fig,  2 shows  the 
quantization  schemes  for  2,  4 and  8 levels,  vdiere  ■»'l 


0 


-I 

+1 

2 

2 

1 0 

-J 

*2 

7 6 

S 4 

2 2 10 

-1  +1 

Fig.  2.  Quantization  zohme  for  2j  4 and  8 tavela 
corresponds  with  a code  symbol  1,  and  -1  with  a code  symbol  0. 

The  spaclngs  in  the  above  schemes  can  be  shown  to  be  almost  optimum, 
nie  Gaussian  channel  with  modulator  and  demodulator  is  then  equi- 
valent to  a discrete  channel  with  two  inputs,  and  2,  4 or  8 outputs, 
respectively.  The  channel  transition  probabilities  are  equal  to  the 


probabilities  that  a \/  variance  Gaussi«m  random  variable  with 

/V  ^ 

variance  y and  mean  1 lies  in  the  intervals  indicated  in  Fig. 
The  problem  we  are  now  faced  with  is  the  adjustment  of  the  syndrome 
decoder.  Take,  for  example,  a 4-level  qu^ultizer  as  indicated  in  Fig. 


2 


4 


Hg»  4,  Probability  dtnoity  function  of  tho  roaoivod 
oignal 

L«t  « r«cttlv«d  signal  lia  In  Intaxval  2.  Tha  syndrosM  fotmlng  circuit 
only  accapts  tha  symbols  0 and  1.  Hancsr  a binary  quantizar  is  usad 
to  sat  tha  racaivad  signal  aqual  to  0.  Now  thara  ara  two  possabilitias , 
tha  ralavant  noisa  bit  could  aithar  ba  zaro  or  ona  with  probability 

can  ba  said  ^d90ut 
a racaivad  sigxial  lying  in  intarval  1.  For  tha  intarvals  0 and  3# 


Pr(0)  - Qj  and  Pr(l)  • raspactivaly.  Tha  s. 


Pr(0)  • % and  Pr(l)  » Q^.  In  fact,  ws  only  naad  tha  absoluta  valua 


of  tha  racaivad  signal  to  datarmina  Pr(0)  and  Pr(l)  and  thus  tha 
branch  matric.  From  simulations,  it  follows  that  tha  dacodar  is  quits 
insansitiva  to  branch  metric  quantization.  Banes,  usa  of  intagars 
instead  of  exact  log  likelihoods  gives  a vary  small  performance 
degradation.  Fig.  5 shows  a possible  sat  of  metrics  for  tha  case  of 
4-laval  quantization. 


Sard  quantized 

Received  quantized 

noise 

level 

0 

12  3 

0 

0 

1 1 0 

1 

3 

2 2 3 

Fig.  S.  Metric  quantization  aaheme 
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In  [1]  la  shown  that  in  ganaral,  tha  numbar  of  dlffarant  stata  aatrles 

for  a R ■ >1  "Vitarbi  Ilka"  syndroaM  dacodar  with  2''  statas  la  aqual 
3 V 

to  ~ * 2 . For  a spaclal  class  of  codas,  this  can  avan  ba  furthar 

raducad  to  (/3)^.  Tha  raductlon  was  mainly  basad  on  tha  fact  that  tha 
branch  matrlc  contribution  of  tha  nolaa  pairs  [0,1]  and  [1,0]  ara  aqual. 
From  Fig,  S it  follows  that  in  tha  soft  daclslon  dacodar,  tha  abova 
mantlonad  contributions  ara  not  always  aqual.  For  axaapla,  lat  a 


racalvad  signal  pair  ba  In  tha  Intarvals  0 and  1.  Than,  tha  branch 
matrlc  for  a [0,1] -branch  Is  2,  trtilla  tha  contribution  for  a [1,0]- 
branch  la  4.  A dlract  consaquanca  la  that  tha  k • h syndroma  dacodar 
has  2 dlffarant  stata  matrlcs.  Each  stata  having  4 antrlas,  which  loads 
to  a mors  ccopUcatad  path  roglstar  rashuffUng  and  matrlc  calculation 
schama  as  ccoqparad  to  tha  Vltarbl  dacodar. 


•j 


OOMCLOSIOMS 


A Mthod  is  glvan  for  soft  doclsion  ”Vltorbi  llko*  syndrono  dacodlng. 
This  Botbod  Is  not  only  valid  for  K • h,  but  for  all  R ■ k/n  "Vltarbl 
llko”  syndroao  dacodars.  Tha  nunbar  of  diffaraat  stata  aatrlcs  in  tha 
R ■ *1  casa  cannot  ba  raducad.  Xt  aaaas  that  tha  advantagas  of  syndroaa 
dacodlng  for  long  cmstraint  langth  codas  disappaar. 


i 


1^' 


tatioa  of  a R a >1  convolutional  dacodar 


Tha  thraa  aajor  functions  to  ba  parfooad  by  tha  ancodar  ara 
1/  datarainatlon  of  tha  bramch  aatrlcs, 

2/  datasninatlon  of  tha  naw  stata  oatrlcs  and 
3/  ganaratlon  of  tha  survivor  saqpianca. 

Tha  hardMsra  coi^laxlty  of  tha  Vltaidil  and  of  tha  syndrosia  dacodar 
strongly  dapands  upon  tha  constraint  Isngth  v of  tha  ancodar,  tha 
coda  rata,  and  also  If  hard  (Q  ■ 2)  or  shoft  (Q  ■ 4,8)  daclslon  1s 
usad  on  tha  racalvad  data  straaa.  First  a ganaral  comparison  will  ba 
mada  for  R • and  Q > 2.  Than  tha  Influanca  of  soft  daclslon  will  ba 
dlscussad.  For  Vltarbl  daeodlng  tha  naw  matrlc  of  any  stata  (S)  Is 
calculatad  according  to 

M (k+l)  ■ min  [{m  (k)  * d(c,r)}  , {M  (k)  + d(c,r)}] 

s as  - - 


tdiara  d(c,r)  danotas  tha  hamming  dlstanca  batwaan  tha  transition  from 
stata  (a  ^S)  to  stata  (S) , and  tha  racalvad  bit  pair  r.  Nota  that 
d(c,r)  ■ 2 • d(c,r),  ^anavar  tha  outamost  stagas  of  tha  ancodar  ara 
connactad  with  tha  mod-2  addars.  Tha  hardwara  treuialatlon  of  (6)  Is 
glvan  In  Fig,  6.  A constraint  langth  v coda,  ragulras  a Vltarbl 
dacodar  with  baslcly  2^  of  thasa  sactlons. 


ADD  d(Otr) 


ADD  2 - dta^r) 


acmpare 
and  aeleat 


M^(k+1) 


Fig,  6,  Add  and  campara  logic 
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In  th«  state  table  of  the  syndrome  decoder  [1],  the  transitions  occur 

b 

in  groups.  One  group  is  given  in  Fig.  7 , where  s^  is 


state 

tranaition  pair 

00 

01 

11 

10 

S 

a"^S 

a ^S*a  ^ 

a ^S*a^*a  ^ 

<x'^S*a^ 

0 ^S+8«^+a  ^ 

a ^S+a  ^ 

a ^S+a  ^ 

~1  b -2 

a S+e„  +0 

cT^S*a^^ 

S+a  ^)a 

0 ^S+a^*a  ^ 

a ^S+s^^+a  ^ 

a“^S+o"^ 

Fig.  7.  Group  of  tranaxtvana 

the  base  state  of  the  syndrome  former.  In  general,  the  syndrome  decoder 

has  2^/4  of  these  groups.  Assume  that,  without  loss  of  generality,  state  (S) 
b -1 

and  state  (S-»’(S2  “Hx  )a)  cause  the  same  syndrome  outputs.  Otherwise 
interchange  (S)  and  (S+a  ^) . The  metrics  for  state  (aS-hx~^)  and  (a'*^S-«'S2^) 
are  calculating  aiccording 

M . .(lc+1)  - M , M (lc)+l]  + 

a"  S+o  a"  S+S2  “ ® S+(S2  +a‘^)a 


z min[M  _„(J«)+l,  M 


‘ b -1 
S+(S2  +a  )a+a 


The  states  with  a term  (a  ) are  called  odd  states.  The  others  are  called 
even  states.  For  the  even  states  (o'^S)  and  (a”^S+S2^+a”^) , the  metrics 
are  calculated  according  to 


■X 


M (k+1)  ■ z min[M  W b -1  + 

a S S+a  S+a  +(82+0  )o 


+ z min[M  (k) , M b 1 

S S+(S2  +a"  )a 


(k)+2] 


The  total  amount  of  hardware,  needed  to  calculate  the  new  state  metrics 


follows  from  Fig.  6,  8 and  9,  and  Is  given  In  Fig.  10 


adders 

comparators 

multiplexers 

Syndrome  decoder 

2^^*2*2^^ 

Viterbi  decoder 

2^^*a 

4.2^^ 

- 

Fig.  10.  Bardaare  needed  to  oalculate  the  new  state  metpias 

Zf  equal  ccs^lexlty  for  all  elonents  Is  assumed,  the  syndrome  decoder 

requires  10*2^  ^ elonents,  while  the  Vlterbl  decoder  does  12*2^ 

In  fact,  this  difference  Is  even  larger,  because  multiplexing  Is  less 

complex  as  compared  to  adding.  An  additional  advauitage  is  the  number 

of  different  state  metrics  of  a syndrome  decoder.  In  [1]  is  proven  that 

3 V 

in  general  this  number  is  equal  to  (j)*2  . Hence,  less  subtractions  from 
each  state  metric  with  the  most  likely  state  metric,  and  less  caparisons 
for  searching  this  most  likely  metric  need  to  be  made.  Next  we  are 
discussing  the  complexity  of  the  path  register  scheme.  The  compaurator 
In  the  metric  calculator,  determines  which  path  Is  the  survivor  for  a 
certain  state.  This  means  that  in  a Vlterbl  decoder,  each  path  register 
has  two  possible  entries,  as  can  be  seen  in  Fig.  11 


select  entry 
from  comparator 


multiplexer 

storage 

Fig.  11.  Four  entries  of  a path  register 
In  general,  the  path  registers  of  the  syndrome  decoder,  have  4 entries, 
as  can  be  seen  in  Fig.  11.  The  multiplexing  for  two  even  states  is 
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i 

la 


.'•-•I 


Fig,  12.  Path  regia  ter  organization  scheme  for  an 


even  pair 

conbined,  as  vias  done  in  Fig.  8 for  the  metric  calculation.  The  same  scheme 
can  be  dravm  for  odd  pairs  of  states.  If  a path  register  length  of  4 
is  assumed,  the  luuKiware  needed  for  the  path  register  organization  in  the 
syndrome  decoder  and  in  the  Viterbi  decoder  is  given  in  Fig,  13, 
respectively. 


storage 

multiplexers 

syndrome 

Viterbi 

4 4 

±L  *9'^ 

4 ^ ■ 

*3 

4 4 

*2'' 



Fig.  13.  Harduare  requirement  for  the  path  register 
organization  scheme 

If  equal  complexity  is  assmed  for  multiplexers  and  storage  cells,  the 

difference  between  syndrome  and  viterbi  path  register  organization  is 
v-2 

2*v*2  elements  in  favor  of  the  Viterbi  decoder.  Together  with  the 
metric  calculation  scheme,  we  can  say  that  the  complexity  of  the  syndrome 


decoder  and  Viterbi  decoder  is  edsout  equal. 


I 

I 
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But  as  proven  in  [1],  the  number  of  different  states  In  the  syndrome 
decoder  can  be  reduced  to  Hence,  for  this  special  class  of  codes, 

the  syndrome  decoder  is  a reasonable  alternative  to  the  Vlterbi  decoder, 
as  it  achieves  an  exponentional  saving  in  hardware.  Note,  that 
is  only  true  for  Q«2,  l.e.  hard  decisions.  If  soft  decisions  are  used, 
the  number  of  different  states  cannot  be  reduced  emd  the  Viterbi  decoder 


is  preferadjle. 
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UNION  BOUND  C«t 


ERROR  PROBABILITY 


EXPLICIT  EVALUATION  OF  VITERBI'S  UNION  BOUNDS  FOR  THE  FIRST  EVENT  ERROR 
PROBABILITY  AND  THE  BIT  ERROR  PROBABILITY  OF  A BINARY  CONVOLUTIONAL  CODE 

ON  A BINARY  SYMMETRIC  CHANNEL 


K.A.  Post 


a 


( 


Abstract.  An  explicit  method  is  given  to  evaluate  Viterbi's  union  bounds  [1] 

on  both  the  first  event  error  probability  and  the  bit  error  probability 

of  binary  convolutional  codes  on  a BSC.  These  bounds  are  explicitly  given 

2 2 

for  the  rate  J code  with  generators  1 D D and  1 '*■  D . Comparison 
is  made  with  boxinds  and  experimental  results  of  Van  de  Meeberg  [2]. 


I.  Let  p and  q be  positive  numbers,  p < p q ■ L 
Following  Viterbi  [1]  we-  define  a sequence 

P|,P2>^2***’ 


by  the  formulas 


=•  I 

j«0  ■' 

k-1  .2k.  2k- j .,2k.  k k 

'2k=-J  J' 


(k  - 1,2,3,...) 


Using  the  well-known  addition  property  in  Pascal's  triangle  we  find 
(P  * ^2k*  that  " ^2k— I " 1»2,3,...) 


and  furthermore 


/ ..  \rt»  1 /2k.  k k^  _ ,2k.  k k 

<P  ‘l)Cp2k  " ^^k^P  ^ ‘I  • 


■2k-fl  '^'k 


so  that 


2k  k k 

^2k+l  “ ^2k  ‘ ■ P><pP  “ 1.2,3....). 


CombLaing  these  results  we  obtain 

Pj  “ P2  “ i ■ (i  ' P> 


P3  - P4  - i - (i  - P)C(J)  + (?)pq] 


.Q/  Vj. 


P5  - Pg  - i - (i  - P)C(J)  + (,)pq  + <2)pV] 


P7  - Pg  - i - (i  - P)C(5)  + (f)pq  + (2>pV  + (3>pV] 


^0'  - 


It  is  a well-known  fact  that  for  complex  z,  |zj  < ^ 

(2)  (1  - 4z)’i  - (J)  + (^)z  ♦ (J)z^  + (^)z^  + ... 

so  chat  Che  generating  function  F for  the  sequence  PpP^iFg*...  must  read 
as  follows 

m 

(3)  F(z)  I P 2^  - --§~  [i  - (i  - p)(i  - 4pqz^)"^]  . 

k-l  * ' * 

The  Taylor-series  in  this  formula  converges  for  complex  z,  |z|  < (4pq) 
since  z * 1 is  a removable  singularity  of  the  function  F. 


2.  Let  6 be  a rational  function  of  the  complex  variable  z,  G(z) 
where  n and  d are  polynomials  having  gcd  one,  and  n(0)  ■ 0. 
G has  a Taylor-expansion  around  z * 0; 


n(z) 
d(z)  ’ 


(4)  G(z)  ■ I g.  z* 

k-1 

For  our  purpose  we  are  interested  in  finding  an  explicit  form  for  the 
expression 


I PfeSv,- 

k-1  ^ 


Recall  that  the  polynomial  d can  be  uniquely  factorized 


S U Ql 

(5)  d(z)  - C(z  - a,)  '(z  - o^)  ^ ...  (z  - o^)  , 

where  C is  a camp lex  constant  and  are  the  distinct  zeros  of  d(z)  with 

multiplicities  mj  (j  > l,...,r). 

Then  G(z)  can  be  decomposed  uniquely  into  partial  fractions 


r A 

(6)  G(Z)  - q(z)  + I I , 

j-i  A-1  o ' 

j 

where  q is  a polynomial  and  A.  are  complex  constants,  q(0)  J.  A.  * 0. 

J*  ■ J f*  J* 

Hence  we  obtain 


*k  “ * X * 1,2,3,...), 

J »* 

where  qj^  is  the  k-th  term  of  q(z)  and  ^j£j^  is  the  k-th  Taylor-coefficient 

of  (1  - -5-)"^  . 
a. 

J 

Let  us  consider  this  Taylor-coefficient  separately.  By  the  binomial  series- 
expansion  we  have 

(8)  (I  - f)"^  - I 4 . 

“ k-O  ^ * o*' 

and  hence,  by  repeated  application  of  the  addition  property  in  Pascal's 
triangle 

(9)  (1  -f)‘^  - I (^)(^;')  4 • 

k-O  t-O  ' ' a*^ 

z 

Therefore,  the  k-th  Taylor-coefficient  of  (I  ) is  equal  to 

a . 

J 

^ A- 1 k — k 

(10)  h.,,  - (\>)(^)  a.  . 


k -k+t  1 k k 

Recall  that  (^)o.  ■ -T  (z  ; 1 » where  (z  ) , _ 1 

tj  t.  z*—  z«  — 

a . o . 

J J 

k 1 

denotes  the  value  of  the  t-th  derivative  of  the  function  z taken  at  z ■ ~ . 

01 . 

Z -i  J 

Hence,  the  contribution  of  the  tern  A.  (1  - — } to  the  value  of  the 

desired  expression  ^ equal  to 

k-1 


* Y (‘-‘)  -i-  . 

i£  t t c a* 

•*  t»0  tluj  J 

provided  that  |— ( < (4pq)  ^ (cf.  (3)). 


li 


3.  We  nov  apply  our  results  to  the  well~knoun  convolutional  code  over  GF(2) 

2 2 

with  generator  polynooials  1 D + D and  1 + D . 

The  function  6 • G_  to  be  taken  for  the  construction  of  the  union  bound 
E 

for  the  first  event  error  p»"obability  P in  CH  is  equal  to 

E 

n f ^ 2^  1 I 12  13  14^1  1 

•"  'r”2z  "“3l  " Te  8 “4*  "I*  32  i-2z’ 

So  we  find  for  the  union  bound  for  P- 


’ Te^l  " 8^2"  4^3"  2**4'^  32 


- (I  - 2p)(l  - 16pq)"^  - 3^-i|-P  - |-P^+  |p^  • 

For  the  construction  of  the  union  bound  for  the  bit  error  probability  Pg  in  [1] 
we  must  take  G ■ Gg  : 

z^  1 3 12.1351  .1  1 

® (1-2z)2  ® ^ 32  1-2Z  32^,_2z)2 

Hence  we  find  as  union  bound  for  Pg 

^ ‘ TC'i  * i'2*  xh  - i 3 

"12*  TTP'"  I2  -2p)(5-96pq)(l  - 16pq)  ^ . 


^ -iJ 


■arTTTyTx^ 


Th«*«  bounds  hold  for  pq  < . 

4.  Ths  first  stcempc  to  find  an  upper  bound  for  the  union  bounds  for  P 

E 

and  Pg  was  made  by  Viterbi  [I].  Van  de  Meeberg  C2]  Improved  this  upper 
bound  using  only  the  fact  that  • P2j^_,  (k  - 1,2,3,...).  Experimen- 
tal measurements  also  have  been  made  on  P_  for  the  special  code  with 

2 2 ° 

8*o*r*tors  1 ♦ D + D and  1 + D . It  turns  out  numerically  that  the  union 
bound  on  Pg  for  this  code  is  closer  to  Van  de  Meeberg *s  bound  than  to  the 
•*perimental  results.  So  it  seems  to  be  useful  now  to  study  the  philosophy 
behind  Viterbi 's  union  bound  in  order  to  obtain  better  bounds. 


Cl]  A.J.  Viterbi.  Convolutional  codes  and  their  performance  in 

communications  systems. 

IEEE  Trans.  Comm.  Techn.  COM- 19  (1971),  751-772. 

C2]  L.  van  de  Meeberg.  A tightened  upper  bound  on  the  error  probability 

of  binary  convolutional  codes  with  Viterbi  decoding. 
IEEE  Trans.  Inf.  Theory  IT-20  (1974),  389-391. 
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CONCLUSIONS 


Our  main  result,  as  described  in  Section  2.0,  is  a 
state  space  formalism  that  can  be  used  to  advantage  in 
fo:rmulating  and  solving  certain  problems  in  the  theory  of 
convolutional  codes.  We  were  able  to  identify  certain 
state  space  symmetries  that  allow  for  an  exponential 
reduction  of  the  haurdware  required  for  the  ia^lementa- 
tion  of  a xaeocimxim  likelihood  decoder.  However,  the  possi- 
bilities of  our  state  space  formalism  are  by  no  means  ex- 
hausted. For  example,  using  this  formalism  1)  we  are  able 
to  improve  on  existing  bounds  on  the  free  distwce  of  fixed 
convolutional  codes,  2)  we  are  investigating  the  possi- 
bilities of  hardweure  reductions  in  maximum  likelihood 
decoders  for  temeory  convolutional  codes,  3)  we  are  inves- 
tigating possible  savings  in  the  amount  of  conqiutation  in 
sequential  decoding,  4)  we  are  searching  for  other  symmetries 
that  could  possibly  lead  to  even  larger  hardware  savings, 
etc.  In  conclusion,  our  present  research  effort  concerns 
the  relation  between  performance  and  complexity  in  convolu- 
tional coding,  where  these  problems  are  formulated  in  a 
state  space  framework. 
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L INTRODUCTION 

riTHIS  ptp«r  extends  and  geneniizH  some  eaiiier  lesults  [1] 
JL  oo  syndnow  decodini  of  nte-4  coovolutionel  codes.  The 
Mntty  code  fenented  by  the  eociMr  of  Hg.  1 will  agsin  be 
used  as  an  examine  thiouilioiit  the  paper.  The  additions  in 
Fig.  1 aie  modulo*2  and  all  binaiy  sequences  b-i,  bj,, 
***  an  mpieaanted  as  power  series  b(ei)  ■ 4-  b-xor^  -4 

bo  + bitt  4*  •>.  The  encoder  has  coimection  pcdynomiais 
Cx(a)  a i 4>  a*  and  Ct(a)  ■ 1 4-  a 4-  a*.  In  general,  the 
encoder  outputs  an  Cx(a)x(a)  and  Cs(a)x(a).  The  syndrome 
s(a)  only  dqwnds  on  A|(a)  and  ny(oX  Le..  not  on  the  data 
sequence  x(aX  for 

z(a)  - C»(«)(Cx(et)x(o)  4-  «x(o)J  4-  Cx(«)IC,(o)*(<»)  + «a(«)l 
-C,(o>tx(«)4.Cx(o>i,(a).  (1) 

Having  fiMmed  the  syndronw  r(a).  Section  m describes  a 
neurahu  algorithm  like  Vltetbi’s  [2]  to  detennine  fhxn  the 
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ENCOOn  I CMAMtfL  i SVNCWOMe 
FOflMGt 

EacodtBtaadqradioiiMfoimiiiifgitJt  > i^cod*. 

syndraoM  z(a)  the  noiie  sequence  pair  [Ai(a)^s(>)]  of  mini* 
mum  tfamniing  weight  that  can  a poasible  cause  of  this 
sjmdiome. 

Given  the  estimate  [^i(a)^3(a)]  of  the  noise  sequence 
pair,  one  deiives  an  estimate  i(a)  of  the  original  data  sequence 
x(a)  as  follows.  For  a noncatastrophic  code,  Cx(a)  and  C^fa) 
are  relatively  prime.  Ibnce,  by  Euclid's  algorithm  [3]  there 
exist  polynomials  f>i(a)  and  2)3(0)  such  that  2)i(a)Ci(a) 
2)i(o)C3(a)  » I.  For  the  exampk  of  Fig.  1,  we  ham  2>i(a)  » 
1 + ox  2)3(0) « o.  We  receive  the  sequence  pair 

yA<*)  ■ Ci(o)x(o)  + n^a\  / » 1, 2,  (2) 

and  form  the  estimate 

Hct)  - 2)x(o)[yj(o)  + /li(o)J  + 2)3(o)[y3(o)  + ^,(0)] . (3) 

Note  that  if  the  noise  sequence  estimate  [^i(oX^3(o)]  is 
correct  we  have 

)'<(«)  + »r(«)  - Cl(o)x(o)  + n^o)  + Arfo) 


<Ci(ayx(a),  2-1.2, 


and,  hence 


i(o) » 2)i(o)Cx(o)x(o)  + 2)»(o)Ca(o)x(o)  - x(o). 


Note  that  (3)  for  the  estimate  i(o)  of  the  data  sequence 
x(o)  can  be  rewritten  as 

JK<*)  - tOx(a)Fr(«)  + 2)3(o)v3(o)1  + w(o),  (4) 
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Pig.  2.  Syadiomefoimainiabawnate. 

sequences  haws  been  omitted  from  Fig.  2.  For  minimum  dis- 
tance decoding  we  are  now  presented  with  the  following  prob- 
lem. Given  the  syndrome  r(o),  determine  the  noise  pair  [^x(oX 
Ag(o)]  of  minimum  Hamming  weight  that  can  be  a cause  of 
this  syndrome.  Before  tackling  this  problem  in  Section  HI,  it 
will  be  necessary  to  first  derive  some  general  properties  of  the 
state  diagram  of  a syndrome  former  for  a binary  rate  con- 
volutional code. 

Let  be  the  number  of  memory  stages  of  the  encoder,  Le., 
t'  — 2 for  the  enMder  of  Fig.  1.  The  corresponding  syndrome 
former  of  Fig.  2 has  2^"  - 16  “physical  sutes,”  where  a 
physical  state  is  defined  as  the  contents  5 — [>1(0X53(0)] , 
where 

i,(o)  - 5,._^*’  + j,  _,+iO-*’*»  + - + 5,._iO-»,  2-1,2, 

of  the  21^  - 4 memory  cells  of  the  syndrome  forttwr.  Thus,  at 
first  sight,  the  state  diagram  of  the  syndrome  former  appears 
more  complicated  than  the  state  diagram  used  to  implement 
the  classicri  Viterbi  decoder  [2] , that  has  only  2*  — 4 states. 
However,  on  closer  inspection,  it  turns  out  that  the  2**  - 16 
physical  states  of  the  syndrome  former  can  be  divided  into 
2*  — 4 equivalence  classes  or  “abstract  states,”  where  any  two 
physical  states  in  the  same  equivalence  class  give  the  same 
output  r(o)  irrespective  of  the  input  pair  [ni(oXn3(o)] . In 
gene^  to  prove  the  existence  of  the  2*.  v - 1, 2,  ’■*,  abstract 
states  defined  above,  we  need  the  following  definitions.  As  the 
syndrome  former  is  a tione  invariant  circuit  we  assume  without 
loss  of  generality  that  the  state  S is  present  at  time  r - 0. 

Definition  I:  A “zero-equivalent”  state  is  a physical  state 
with  the  property  that  if  the  syndrome  former  is  in  such  a 
state,  an  all-zero  input  [Ri(ctX'i3(a)lo**  rise  to  an  all- 
zero  output  [z(a)]o**,  where  [b(a)]hj**  indicates  that  part 
of  the  power  series  b(a)'for  whi^  ki  < exp  a < ^3. 

Definition  2:  A “base”  sate  5*  — [a**^  ,53^(0)]  is  a zero- 


cu(a)  - 2)i(a)«i(d)  + 2>3(a>i,(o).  (5) 

and  (!i(a)  equals  the  iight4iand  side  (RHS)  of  (S)  with  R|(a) 
substitutad  for  R|(aX  2-1,2.  The  term  in  square  brackeu  in 
(4)  can  be  computed  directly  from  the  received  data  usii^  very 
simple  dicuitiy.  As  there  is  no  need  to  distinguish  between 
pain  [Ai(aX^3(a)]  and  [Ai(aX^a(<t)]'  that  lead  to  the  same 
value  for  <^a)  in  (4),  the  al^dthm  to  be  discussed  in  Section 
in  computes  ^a)  dhnsctly. 

n.  STATE  DIAGRAM 

In  Fig.  2 we  have  redrawn  the  syndrome  former  of  our 
example.  As,  according  to  (1),  the  syndrome  r(a)  only 
depends  on  the  noise  pair  (Ri(aX/i3(a)] , all  other  binary 


74 


equivalent  staa  with  a single  “1”  in  the  rightmost  position  of 
the  top  register  of  the  syndrome  former,  see  Fig.  2. 

A base  state  can  be  constructed  u follows.  Start  with  the 
top  and  bottom  registett  of  the  syndrome  former.  Fig.  2,  all 
zero.  Put  a 1 in  the  leftmost  position  of  the  top  register. 
Assuming  that  C}(a)  and  C3(a)  both  have  a nonzero  teim  of 
degree  »,  we  now  have  to  put  a 1 in  the  leftmost  position  of 
the  bonom  register,  u otherwise  the  corresponding  digit  of 
the  syndrome  r(o)  would  differ  from  zero.  Subsequently,  shift 
the  contentt  of  the  top  and  the  bottom  register  one  place  to 
the  right,  feeding  0‘s  into  both  leftmost  positions,  respectively. 
If  the  corresponding  digit  of  the  syndrome  z(a)  difters  from 
zero  set  the  leftmost  position  of  the  bottom  register  equal  to 
1,  thus  complementing  the  corresponding  syndrome  digit,  etc. 
This  process  continues  until  the  single  1 in  the  top  register  is  in 
the  rightmost  position.  The  bottom  register  now  contaiiu 
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s«*(a).  It  is  clnr  that  the  above  coostniction  leads  to  a unique 
result.  This  base  state  5*  is  indicated  in  the  example  of  Rg.  2. 
However,  there  might  conceivably  be  another  construction 
leading  to  a difTerent  base  sute.  7^  following  theorem  shows 
that  this  is  not  the  case. 

Theorem  1:  The  base  state  Js^(«)]  is  unique. 

Proof:  Stq>poie  there  ate  two  base  states  S\^  and  St^. 
These  base  states  are  sero^quivalent  states,  hence,  so  is  their 
sum  S • S\*  But  as  the  sum  of  two  base  states  the 

physical  state  S hat  aU  zeros  in  the  top  register  of  the  syn- 
drome former 

As  Cx(a)  hu  a nonzero  term  of  degree  v,  the  only  zero- 
equivalent  state  with  the  top  register  contents  aU  zero  is  the 
aQ-zeto  state.  Hence.  5 is  the  all-zero  state  and  the  physical 
states  S\*  and  ate  equaL  Q.E J>. 

We  will  now  show  that  there  are  Z'  equivalence  classes  of 
physical  states  and  that  each  class  has  a unique  representative 
physical  state  for  which  the  contents  of  the  top  register  of  the 
syndrome  former,  Rg.  2,  is  all  zero.  It  is  these  represenutive 

s « [04«(a)] , to  be  referred  to  as  '*the  sutes,”  that  will 
be  used  in  the  remainder  of  the  paper. 

Theorem  2:  The  2**.  v « 1, 2,  physical  states  of  the  syn- 
drome former,  corresponding  to  a binary  rate--^  ettcoder 
with  » memory  cells,  can  be  divided  into  2*  equivalence  classes 
or  abstract  states.  Each  equivalence  class  has  a unique  repre- 
sentative physical  state  S « [0,sa(a)l  for  which  the  top 
register,  see  Fig.  2,  of  the  syndrane  former  is  all  zero. 

Proof:  Two  physical  states  were  related  if  they  resulted 
in  the  same  output  t(a)  irrespective  of  the  input  pair  [ni(a), 
/ta(a)] . To  prove  that  this  relation  is  an  equivaletKe  relation, 
we  mutt  sh^  that  it  is  reflexive,  synunetric,  and  transitive. 
Reflexivity  and  symmetry  are  obvious.  To  show  transitivity 
let  be  related  to  8%  and  be  related  to  S^.  Since  Si  and 
S%  produce  the  same  output  t(a),  their  sum  5i  -l*  5a  is  a zero- 
equivaient  state,  as  is  5a  5s.  But  5i  -i*  5s  « (5i  + 5a) 
(5a  + 5s).  Hence,  5i  5s  is  the  sum  of  two  zero-equWaknt 
states  and  thus  also  zero  equivalent.  In  other  words,  the  phys- 
ical sates  5i  and  5i  -t-  (5i  -t*  5s)  • 5s  produce  the  same 
output  z(a)  and  thus  the  relation  ^fined  ^ove  is  transitive. 
This  completes  the  first  part  of  the  proof.  The  relation  defined 
above  is  an  equivalence  relation  and,  hence,  divides  the  set  of 
physical  states  into  equivalence  classes  or  abstract  states.  As 
the  sum  of  zero-equivalent  states  is  again  zero  equivalent,  left 
shifts  of  the  base  state  5*  can  be  added  to  the  all  zero  state  to 
obtain  a zero^quivalent  state  for  whidi  the  top  register  has 
any  desired  contents.  Two  zero-equivalent  sates  5i  and  5^ 
that  have  the  same  top  register  contente  are  identical,  for 
Hia<r  sum  5 * 5i  -1-  5«  is  a zero-equivalent  state  with  top 
register  contente  all  zero.  Hence,  as  shown  in  the  proof  of 
Theorem  1, 5 is  the  all-zero  sate  and  thus  5}  « 5^.  In  other 
words,  there  are  2*  zero-equivalent  sates  and,  in  fKt,  aU 
equivalence  classes  have  V members,  giving  2**11*  • 2* 
abstract  sates.  As  we  can  add  left  shifts  of  the  base  sate  SP  to 
any  particular  physical  sate  without  leaving  its  equivalence 
class,  each  equivalence  class  has  a represenative  member, 
called  the  state  5 « [043(a)] , that  has  the  contents  of  the 
top  register.  Fig.  2,  of  the  syndrome  former  all  zero.  To  prove 
ui^ueness  of  the  represenative  state  within  an  equiv^nce 
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class,  assume  two  represenative  sates  Si  and  5s.  The  sum 
5i  -t-  5s  of  two  represenative  states  S\  and  5s  within  the 
same  equivalence  class  is  a zero-equivalent  sate  with  top 
register  contente  all  zero.  This  sum  sate  again  must  be  the 
all-zero  sate.  Hence,  5i  + 53  » 0 or  5i  « 5s,  proving  that  the 
represenative  sate  of  an  equivalence  class  is  unique.  Q.E.O. 

We  ate  now  ready,  as  an  example,  to  construct  the  state 
diagram,  see  Fig.  3,  of  the  syndrome  former  of  Hg.  2.  The 
sates  5o  ■ [0,0],  5i  ■ [0,o~il,  * (04t“*l,  and  5$  - 

[0  P cT^  ] are  represenative  sates  with  the  contents  of 
the  bottom  register.  Fig.  2,  of  the  syndrome  former  equal  to 
00, 01,  10,  and  11,  respectively.  An  input  [ffi(aXA3(a)]o**  * 
[0,1]  brings  us  from  state  So  to  state  Si.  An  input  [/ii(aX 
A3(a)}o*’  * [1.0]  brings  us  from  sate  So  to  sate  5*  » 
[a~’^,0],  whi^  is  not  a representative  physical  sate.  The 
represenative  state  in  the  equivalence  clan  of  5*  can  be  found 
through  addition  of  the  bate  sate  SP  * [<s~^ 43^(0)] , where 
*a*(®)  “ «“*  from  Fig.  2.  Hence,  5*  + 5*  * [0/t“*  + 
a~*’],  i.e.,  an  input  [ni(aXn3(a)]o°  * [1.0]  brings  us  ftom 
sate  So  to  sate  5$  « 5*  -<■  5^.  In  the  same  fashion  [ni(a), 
R3(o)1o**  * [1,1]  brings  us  from  sate  5q  to  sate  53.  All 
states  in  the  sate  diagram  of  Fig.  3 have  now  been  identified 
and  we  leave  it  to  the  reader  to  fill  in  the  remaining  edges.  A 
solid  edge  in  Fig.  3 indicates  that  the  syndrome  digit  corre- 
sponding to  the  particular  transitioa  is  0,  a dashed  edge 
corteqronds  to  a syndrome  digit  1.  The  numbers  next  to  the 
edges  are  the  values  iti,  /13;  <0.  As  has  been  explained  in 
Section  I,  it  is  the  coefficients  **-,  coo,  u>i,  *'*  of  the 
power  series  u(a)  of  (S)  that  one  is  teaUy  interested  in.  It 
requires  some  explanation  that  the  genetic  value  w of  these 
coefficients  can  also  be  indicated  next  to.  the  edges  in  Fig.  3. 

Theorem  3:  The  value  of  the  coefficient  Wh  of  the  power 
series  w(o)  ■ — + cj_io“^  + cjo  + wi«  + defined  by  (5) 
is  uniquely  determined  by  the  sate  5(A)  of  the  syndrome 
former  at  time  r * A and  by  the  value  of  its  input  [Rih,n3k]  > 
A--,-l,0,+l,-. 

Proof:  As  the  syndrome  former  is  a time-invariant  cir- 
cuit, all  one  must  prove  is  that  wq  is  uniquely  determined  by 
5(0)  and  [nio.'iso]  • Equation  (5)  can  be  rewritten  as 
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«o  * + (^lo^io  ■Dao«ao)i 

(6) 


As  5(1),  in  fact,  defines  [ni(a>n3(flt)]  — to  within  such  an 
equivalence  class,  5(1)  uniquely  detninines  Q.EJ). 


1 

a 


i 

h 

h 

t: 


where  the  prime  on  A'(®X  i *■  1>  2,  indicates  that  a possible 
constant  term  Dm  has  been  omitted.  The  second  term 
(Dio/tio  -t-  D2of>2o)  0°  ^ of  (6)  " completely  deter- 
mined by  the  input  (nio«'iaol  to  the  syndrome  former  at  time 
r « 0.  Now  if  the  state  5(0)  of  the  syndrome  former  at  time 
r a 0 determines  [Ai(a)iN2(a)]_v~t  and  if  deg  Diia)<  » 
and  degf>i’(a)  <»,  then  5(0)  determines  the  value  of  the  first 
term  [X>x'(®>*i(®)  f7a'(®>*a(®)]o**  on  the  RHS  of  (6)  and 

we  are  done.  Nw  from  Berlekamp  [3,  p.  27]  we  know  that 
there  exist  polynomials  f>i(o)  and  Z>a(a)  satisfying 
D\{a)Ciia)  + f>a(a)Cs(a)  « 1 and  thus  that  deg  f)i(a)  < 
deg  Ca(a)  and  deg  f>2(a)  < deg  Ci(a).  Hence,  the  degrees  of 
both  f>i'(a)  and  Z>s'(a)  ate  less  than  the  common  degree  v of 
Ci(a)  and  Ca(a).  However,  the  state  5(0)  determines  [rii(aX 
'>a(®)]-v~^  only  to  within  an  equivalence  class.  It  thus 
remains  to  be  shown  that  addition  of  a aro-equivalent  state 
5 * [si(aXsa(a)]  does  not  affect  the  value  of  [^i'(a>ii(a)  + 
X>3'(a)Ra(a)]o**.  For  a zero-equivalent  state  we  have  by 
definition 

(Ca(a)»i(a)  -t-  Ci(a)sa(a)l o"  - 0.  (7) 

From  f>i(a)Ci(a)  + f7s(®)C3(a)  «•  1 it  follows  that 
Dx'(a)Ci(a)  + Dt'iayCtia)  » 0.  Thus  we  can  define  the  poly- 
nomial ^a)  by 

P{a)  - i>x'(a)Cx(a)  - f)a'(«)Ca(a).  (8) 

It  now  follows  that 


m.  ALGORITHM 

As  the  recurshre  algorithm  to^  described  in  this  section  is 
similar  to  l^terbi’s  [2] , we  can  be  very  brief.  For  reasoru  of 
daiity  the  decoding  algorithm  will  be  explained  using  the  code 
generated  by  the  encoder  of  Rg.  1 as  an  example.  Rg.  4 repre- 
sents the  Arfii  section,  k • *-*,  -1,  0,  -t-l,  of  the  trdlis 
diagram  corresponding  to  the  state  diagram  of  Rg.  3.  The 
decoding  algorithm  is  to  find  the  coefficients  of  the  power 
series  w(a)  ■ — + co-ia”'  + cjq  + toja  + associated  with 
the  path  of  minimum  weight  throi^  the  tteOis  diagram.  The 
pertinent  weight  is  the  Hamming  weight  of  the  pair  Ifii(q), 
na(a)]  associated  with  the  particular  path.  As  in  the  >^t^i 
algorithm  [2| , to  find  the  minimum  weight  path  we  associate 
a metric  with  each  possible  state.  The  metrics  at  time  r » k can 
be  computed  recursively  given  the  metrics  at  time  r » it  — i. 
For  the  trellis  diagram  of  Fig.  4,  the  recursion  is  given  by 

3fo(*  + 1)  - I*  min  tMo(*),3fx(ifc)  + 2] 

+ *fcmint«fi(A:),ifa(Jfe)  + 2l  (11a) 

Mi(k  + 1)  - Xfc  min  [Ma(*)  + Ir^faOt)  + U 

+ X*  min  IMo(*)  + l,Afr(*)  + 1]  (1  lb) 

3fa(*  + 1)  - Xfc  min  {Wo(*)  + 2,Jfi(*)] 

+ Xfc  min  [Miik)  + 2,JHa(ifc)]  (1  Ic) 


/(a)Pi'(o)ix(a)  +i>a'(«)»2(«)] 

- Dx  '(o)Da'(®)IC,  (®)fi(«)  + Cx(o)ia(o)] . 


(9) 


As  deg  Cx(a)  > deg  i>a'(®)>  F(a)  > deg 

Di'(a)D2(a).  Thus,  if  [f>i'(o)rx(a) + f7a'(®)*2(®)]  ^ > o®®' 
zero  term  of  degree  0,  then  [Ca(a)sx(a)  + Cx(a>a(®)l  would 
have  a nonzero  term  of  degree  larger  than  0.  As,  according  to 
(7),  this  caimot  be  the  case  it  follows  that  [i?x'(®)ti(®) 
^a'(«)*a(a)lo®-0.  Q.EJ). 

In  fact,  we  even  have  the  stronger  result  that  all  edges 
leading  to  the  same  sute  5(k  + 1),A; « ■*-, -1,0, 4-1,— , have 
the  same  value  of  associated  with  them. 

ComBary:  The  value  of  <<;«,  k » — , —1,  0,  +1,  — , is 
uniquely  determined  by  the  value  of  5(k  4- 1). 

lioof:  As  the  syndrome  former  is  a time4nvatiant  cir- 
cuit, aU  one  must  prove  is  that  cjq  is  uniquely  determined  by 
the  state  5(1)  of  tte  syndrome  former  at  time  r * 1.  Accord- 
ing to  (6),  the  value  of  cjq  uniquely  determined  by  [nx(a), 
/ia(®)]— r«i®  **  tbe  degree  of  both  Z>x(®)  >od  D^ia)  is  lest 
than  the  common  degree  v of  Cx(a)  and  Ca(a).  In  fact,  we 
only  need  to  know  [nx(aX/ia(a)]— ^^-x®  io  within  an  equiva- 
lence class.  The  proof  is  identical  to  the  proof  of  Theorem  3, 
except  that  we  redefine  ^a)  of  (8),  as 


(2(0)  -:>x(«)Cx'(a)  4-Z)a(a)Ca’(o). 


(lOX 


3f,(Jfe  4- 1)  - Xfc  min  tMa(*)  + l,3f8(*)  4- 1] 

4-  X*  min  ta/o(*)  4- 1, jlfx(*)  4- 1] , (1  Id) 

where  Zj,  is  the  modulo-2  complement  of  x^,  Ar « — , -1, 0, 
4-1,  — . Note  that  for  each  value  x^  « 0 orxj^  a i two  arrows 
impinge  on  each  {k  4-  l)4tate.  The  arrow  associated  with  the 
minimum  within  the  relevant  pair  of  square  brackets  in  (11) 
is  called  the  “survivor.*’  If  both  arrows  hm«  this  property,  flip 
a coin  to  determine  the  survivor.  In  the  dattical  Viterbi  [2] 
implementation  of  the  algorithm  each  state  ^ « 0, 1, 2,  3, 
has  a metric  register  MR^  and  a path  register  PR^  associated 
with  it  The  metric  register  is  used  to  store  the  current  metric 
value  4-  1)  at  time  r ^ k,  k • -1, 0, 4-1,  — , associ- 

ated with  state  5/,  / « 0,  1,  2,  3.  The  path  register  PR^(0 : 
27—1]  stores  the  co-values  atsodat^  with  the  current 
sequence  of  the  D most  recent  survivots  leading  up  to  state  5| 
af  time  r « it  The  pertinent  output  is 

CONTENTS  PR^(fc)  [2) -1:D-1],  (12a) 

vidiere/(A)  minimizes  3f;(A;  4- 1),  i.e., 

Mjik)(k 4- 1) - minAfy(it  4- 1).  (12b) 

If  mote  than  one  / satisfies  (12b),  select  f(k)  arbitrarily  among 
the  candidates.  As  the  algorithm  returns  Uk—o  l * k, 
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of  tiM  tnSii  (Munm.A  • -1, 0,  -f  1,  — . 


TABLE  I 

METRIC  TRANSITIONS 


Old 

Hatties 

•ttvlvees 

Hew 

astties 

Msw 

Hetties 

0000 

0C2,3> 

(2,3) 

0101 

3 

(0,1)3(0,1) 

0101 

0101 

0 

3 

1 

3 

0111 

2 

0 3 0 

0111 

. om 

0(2,31 

(3,31 

0213 

2 

0 3 0 

0000 

0213 

0 

3 

(0,1) 

2 

0333 

3 

0 3 0 

0010 

0333 

oia.j)  (p.i)  ».j> 

0323 

2 

0 3 0 

1010 

0010 

0 

3 

1 

3 

0101 

3 

(0,1)3(0,11 

1101 

0J2S 

0 

3 

0 

2 

0333 

3 

0 3 0 

1030 

1010 

0 

3 

1 

3 

1101 

2 

1 3 1 

1101 

1101 

0 

3 

2 

0000 

3 

(0,1)3(0,1) 

0313 

1030 

0 

3 

3 

1101 

(S.at  I ) 1 

3101 

2101 

0 

2 

3 

1000 

3 

1 3 1 

0313 

1000 

0I2.J) 

1 

(3,3) 

1101 

3 

1 3 1 

0101 

k • , the  ptth  register  lengdii?  if  alio  nfened 

to  as  the  coding  delay.  Ilie  msuhing  bit  mat  probability 
decnaies  as  the  coding  delay  Dincnasas.Iiicnaringi>  beyond 
S(v  -t-  1)  does  not  lead  to  appreciable  fiiither  decieaae  in  the 
Tiiiie  of  ?t.  This  idadon  between  the  bit  error  probability 
and  the  coding  delay  D will  be  elaborated  on  further  in 
Section  VL  The  next  section  is  concerned  with  a practical 
implementation  of  the  syndrome  decoder. 

IV.  IMPLEMENTATION 

So  far,  the  syndrome  decoder  has  only  been  of  theoretical 
interest  as  a possible  aitemathe  for  the  daiaical  Viterbi 
decoder  [2] . We  will  now  study  a pneticai  implementation 
and  in  the  next  section  make  some  comparisotu  as  to  the  rda> 
tiro  hardware  complexity  of  these  competing  decoders. 

Using  (11)  we  construct  Table  L The  first  cdumn  just 
numbers  the  rows  of  the  table.  The  second  column  lists  all 
poaaftle  metric  combinations  dfo(^)i  M(^)t  ^a(^)>  ^a(^)  d 
time  k •>!.  As  only  the  diffetences  between  the  metiica  of  a 
quadnqde  matter,  we  substmet  fitom  each  member  of  a quad- 
nt^  of  metiks  the  "da*™*™  value  of  the  quadruple,  Le.,  all 
quadruples  of  metifcs  in  Table  I hero  one  or  more  zeros. 
Columns  3 and  4 appfy  to  the  case  that  • 0 and  columns  S 
and  6 to  the  case  that  *■  1.  Cotumns  3 and  S list  the  sur> 
vivors,  Le.,  the  indices  of  the  airociated  (k  — 1)  states,  and 
columns  4 and  6 the  new  metrics  M^{Jt  1),  + 1), 

Afa(jb  4- 1),  jlfs(k  + 1)  as  given  by  (ll).Iftheraisa^oieeof 
survivors,  the  candidates  are  placed  within  parentheses  in  the 
survivor  columns. 

Table  I contains  more  information  than  is  necessary  for  the 
actual  implementation  of  the  syndrome  decoder.  As  explained 
fas  Section  m,  knowiadge  oftba  survivor  leading  to  each  state, 
together  with  the  index  /„,  of  the  minimum  within  each  new 
quadruple  of  metrics,  suffices  to  determine  the  key  sequence 
cj(a)  of  (S).  Hence,  we  omit  the  quadruples  of  metrics  from 
Table  1 and  store  the  resulting  Table  II  in  a iead*only  memory 
(RCMf)*  The  operation  of  the  core  part  of  the  syndrome 
decoder  can  now  be  explained  using  the  block  diagram  of 


Fig.  S.  Assume  that  at  time  k the  ROM  address  register  AR 
contains  (AR)  « 7 and  the  ROM  data  register  DR  contains 
(DR)  « (ROM,?).  Note,  see  Fig.  4 and  also  the  corollary  to 
Theorem  3,  that  the  (upvalues  to  be  shifted  into  PRo  [0:0], 
PRi[0:0],  PRs[0:0],  PRa[0:0]  ate  0011,  respectively. 
Let  Zh  ai  1.  Then  according  to  tow  7 and  column  5 of  Table  H, 
or  according  to  the  contents  (DR)  of  the  DR,  replace 

PR«[1:D-  n >^CONTENTSPR,(l:D-  1] 
PRill:D-l]  CONTENTS PRiIl:D-l] 

PR»(1:D-  1]  ^CONTENTS PR,(1:D-  1] 
PR,[1:D-11  <^CONTENTSPRi[l:D-l]. 

The  rightmost  digit,PRoP  - 1 :D  - 1]  ,PRi  [D  - 1 :D  - 1] , 
PRa[D  - 1 :D  - 1] , PRa[D  - 1 :D  - 1] , of  afi  four  padi 
tegisM  is  fed  to  the  sde^r,  see  Fig.  S,  that  determines 
c2ik— o according  to  (12a)  using  u j(k)  the  entry  in  row  7 and 
column  7,  * 2,  of  Table  II  which  can  also  be  found  in 

the  DR.  To  complete  the  kth  cycle  of  the  syndrome  decoder, 
set  (AR)  • 8 and  read  DR  (ROM3).  The  ROM  decoder  for 
the  code  of  Fig.  1 has  been  realized  in  hardware  using  path 
registen  of  lengdi  D » 11.  The  experimental  results  will  be 
discussed  in  Section  VI. 

V.  PATH  REGISTER  SAVINGS 

The  ROM4mpiementation  of  the  syndrome  decoder  u des* 
cribed  in  Section  IV  has  been  realized  for  the  codes  listed  in 
column  2 of  Table  m.  We  will  discuss  some  interesting  aspects 
of  this  table.  The  first  row  lists  several  properties  of  code  1 
that  wu  used  as  an  example  throu^out  the  eaiUer  part  of 
the  paper.  Colunm  3 lists  tto  number  of  metric  combirutioRS 
of  tte  various  codes.  The  classical  ^^terbi  decoder  [2]  can  also 
be  realized  using  a ROM  in  the  maimer  described  in  Section 
IV.  However,  the  ^^teIbi  decoder  for  code  1 has  31  metric 
combiiutions,  whereas  the  syndrome  decoder  has  only  12 
metric  combiiutions.  For  the  v • 4 codes  this  difference  is 
even  more  pronounced.  For  codes  2 and  3 the  syndrome 
decoder  has,  respectivrty,  1686  and  1817  metric  combiru* 
dons,  whereu  the  clasaical  >^teibl  decoder  for  either  of  these 
codes  has  more  than  IS  000  metric  combinations.  Note  that  in 
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TABLED 

CONTENTS  OF  THE  ROM 


ymrmt 

1 

tewiwors 

ROM 

RddrvM 

liidw 

Jurrivors 

ROM 

Mrtrw 

ladw 

0 

0(2.3) 

t 

(2.3) 

(0.2) 

(0.03(0.1) 

(0.2) 

1 

0 

2 

t 

2 

2 

0 

0 3 0 

2 

0 

a 

0(2.3) 

t 

(2:3) 

3 

0 

0 3 0 

0 

(0.1. 2,3) 

3 

0 

2 

(o.tr  2 

4 

0 

0 3 0 

$ 

(0.1.3) 

4 

0(2.3) (0.1)(2,3) 

« 

0 

0 3 0 

7 

(1.3) 

s 

0 

t 

3 

<Oo2) 

(0.03(0.0 

8 

2 

4 

0 

2 

0 

2 

4 

0 

0 3 0 

9 

(1.3) 

7 

0 

3 

1 

3 

4 

2 

1 3 1 

8 

2 

$ 

0 

2 

i 

2 

0 

(0.1.2.3) 

(0.03(0.0 

3 

0 

9 

0 

3 

t 

3 

• 

2 (2 

3)  1 3 1 

10 

2 

10 

0 

2 

1 

2 

11 

0.2.3) 

1 3 1 

3 

0 

U 

0(2.3) 

t 

(2.3) 

8 

2 

1 3 t 

(0,2) 

PRglOMljq 


WjIftO-lQ 

P«jIO.O-l|jT| 


SELECTOR: 

Jm 

Pif.  5.  Block  diignm  of  the  con  of  the  sjmdiome  decoder. 


TABLE m 
CODES  REAUZED 


COHMOtiOII 
poXyi— iilMi 
[>«th  ovter  rigtic 

IWhT  Of 

■ocrle  COM* 
blnifiono 

MtillM  diRtooeo 

ouMbor  of  potb 
ro«iot«co 

.•tts  «c 
di.- 

swe* 

tocoi  aw 
bar  of  ROW 
•ooutod 
bit  «Rors 

lot 

12 

3 5 

1 

1 

m 

4 

2 

4 

10011 

1.484 

12  7 

2 

4 

11011 

4 

12 

10011 

t.aiT 

9 7 

3 

7 

10111 

8 

3 

10 

10011 

11.304 

12  7 

2 

4 

11101 

8 

4 

12 

cohmuM  5,  6,  and  7 both  etror  «mts  at  the  free  distance  and 
enor  events  at  the  &ae  distance  plus  one  are  considered.  In  a 
bhuzy  comparison  with  the  no-error  sequence,  an  error  event 
at  distance  2A:  hat  the  same  probability  of  occurrence  [4]  as  an 
error  event  at  distance  2Jt  - 1,  h ■ 1, 2,  ■**.  Thus,  in  the  case 
that  the  fitee  distance  is  odd,  error  events  at  the  fine  distance 
plus  one  should  also  be  considered  when  comparing  codes  as 
to  the  bit  error  probability  Studying  columns  S,  6,  and  7 
of  Table  m,  we  obaerve  that  u far  as  the  bit  error  probability 
is  concerned  code  4 is  indistinguishable  from  codes  2 and  3. 
However,  the  syndrome  decoder  for  code  4 requires  11  304 
ROM4ocations  and  code  4 is  thus,  from  a complexity  point 
of  view,  inferior  to  codes  2 and  3. 

The  number  of  metric  combiiutloiu  increases  rapidly  with 
the  constraint  length  p of  the  code.  Hence,  for  larger  values  of 
V the  size  of  the  ROM  in  the  implementation  according  to 
Section  IV  soon  becomes  prohibitive.  In  the  classical  imple- 
mentation [2]  with  a mbtric  regitter  and  a path  register  for 


each  state  5/,  / « 0,  1,  2*  - 1,  the  l^terbi  decoder  and  the 

syndrome  deroder  require  roughly  the  same  amount  of  hard- 
ware per  state.  However,  comparing  (1  lb)  and  (1  Id)  for  code 
1,  one  observes  that  and  5$  have  the  same  metric  value. 
Moreover,  selecting  the  identical  survivor  in  caae  of  a tie.  Si 
and  5|  also  have  the  same  path  register  contents.  As  fu  as 
metric  and  path  register  contents  are  concerned,  the  states  Si 
and  Ss  are  not  distincL  The  metric . register  and  the  path 
register  of  either  state  Si  or  state  Sj  can  be  eliminated.  Thus, 
in  the  classical  implementation  with  metric  registers  and  path 
registen,  the  syndrome  decoder  for  code  1 requires  only  ^ of 
the  amount  of  hardware  that  the  Viterbi  decoder  requires.  We 
will  prove  that,  in  general,  one  can  eliminate  the  metric  and 
path  registers  of  half  the  odd  numbered  states,  where  the  state 
number  of  a represenutive  state  S « [04a(o)]  is  the  value  of 
the  contents  of  the  bottom  register  of  the  syndrome  former 
interpreted  u a binary  number,  i.e.,  odd  states  have  sa,_i  <■ 
1.  Hence,  the  syndrome  decoder  is  at  most  ‘I  as  complex  u 
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is  the  Viteifoi  decoder.  Looking  again  at  Table  III  column  4 we 
see  that  code  1 can  be  realized  with  3 instead  of  2”  » 4 path 
registen,  and  that  codes  2 and  4 can  be  realized  with  12 
instead  of  2*  « 16  path  registers.  Code  3 requires  even  fewer, 
Le.,  nine  instead  of  2"  =•  16  path  registers.  We  now  prove  that 
the  syndrome  decoder  is,  in  general,  at  most  j as  complex  as 
is  the  Vitetbi  decoder. 

Theorem  4:  The  odd  numbered  (representative)  states 
S(l)  » [042(a)]  and  •S'(l)  “ t04a'(a)l.  where  S2'(a)  * 
*2(a)  4*  S2*(a)  4-  a~^  have  identical  metric  equations,  com- 
pare (11b)  and  (1  Id),  iffCi.o  * C2.0  * Ci,»  » C2,»  = 1 . 

Proof:  An  odd  numtered  state  .3(1)  » [042(a)]  has 
S2.— 1 1.  If  both  connection  polynomials  Cx(a)  and  C2(a) 

have  a nonzero  term  of  degree  v,  it  follows  from  the  construc- 
tion of  the  base  state  S*  that  = 1.  Hence,  S2'(a)  = 

Sj(a)  4-  S2*(a)  4-  a~t  has  I2.— I'l  **  I*  and  the  requirement 
that  both  5(1)  and  5'(1)  are  odd  numbered  states  is  consistent. 
Consider  the  following  parent  states: 

5,(0)  » [0,o82(a)]-v-‘ 

5fc(0)  » [0,0“*  + as2(a)] 

5e(0)-[0,os2'(a)}_,“i 
5d(0)  » [0,o“*  + cb2  '(a)J  . 

As  both  Cx(o)  and  03(0)  have  a nonzero  term  of  degree  v, 
5,(0)  and  5^(0)  give  rise  to  complementary  syndrome  digits, 
and  so  do  5,(0)  and  5^(0).  For  an  input  [nxo./>2o]  * [0,1] 
the  parent  states  5,(0)  and  5»(0)  go  into  5(1)  and  the  parent 
states  5,(0)  and  5,^(0)  go  into  5'(1),  and  vice  versa  for  an  input 
['iio>"2o]  * [1 ,0] . Assuming  that  Cx(o)  and  C2(o)  both  have 
a nonzero  constant  term  and  that  [nx 0.^20]  either  [0,1]  or 
[1,0] , the  syndrome  value  only  depends  on  the  parent  state 
5(0).  Hence,  5(1)  and  5'(1)  have  identical  equations.  Q.E  J>. 

Theorem  4 proves  that  the  syndrome  decoders  for  the  v a* 
4 codes  2, 3,  and  4 in  Table  m can  be  realized  with  no  more 
than  12  instead  of  2*  » 16  path  registers.  Column  4 of  Table 
m shows,  however,  that  code  3 requires  oniy  9 instead  of  2*  » 
16  path  registers.  The  following  theorem  shows  how  this 
further  reduction  in  hardware  can  be  accomplished. 

Theorem  S:  One  4-tuple  of  pairs  of  odd  numbered  parent 
states  gives  rise  to  two  pairs  of  odd  numbered  states  that  have 
identical  metric  equations  iff  Cx^  « C24.  and  Cx^r-x  • 

Proof:  Assume  that  5,(0),  5^(0),  5,(0),  and  5^(0)  in 
the  proof  of  Theorem  4 are  odd  numbered  states,  i.e.,  S2,— s * 
S2.-a'  * !•  'lUs  can  be  a consistent  requirement  if  S2.— a*  * 
0,  and  from  the  construction  of  the  base  state  5*  it  is  clear 
that  Sa._,»  - 0 iff  Cx.,_x  - Ca,._x-  If  5.(0),  Se(0),5,(0). 
5^(0)  an  odd  numbend  states,  then  according  to  Theorem  4 
then  exists  a corresponding  4-tupie  of  odd  numbend  states 
5.'(0),  5t'(0),  5,’(0),  5a '(0)  such  that  the  comsponding  com- 
ponents of  these  4-tuples  have  identical  metrics.  According  to 
Theorem  4,  the  first  4-tuple  5,(0).  5»(0).  5,(0),  5^(0)  gives 
rise  to  the  states  5^(1)  and  5,(1)  that  have  identical  metric 
equations.  Similarly,  according  to  Theonm  4 the  second 
4-tuple  5,'(0),  5»'(0),  5,'(0),  5a ’(0)  gives  rise  to  the  states 


5p'(l)  and  5,'(1)  that  also  have  identical  metric  equations.  As 
the  comsponding  members  of  the  pannt  4-tuples  5,(0), 
5»(0),  5,(0),  5a(0)  and  5,’(0),  5,'(0),  5,'(0),  5a,(0)  have 
identical  metrics,  the  four  states  5p(l),  5,(1),  5p'(l),  and 
5,'(1)  have  identical  metric  equations  iff  corresponding  states 
in  the  pannt  4-tuples  give  rise  to  the  same  syndrome  digit. 
For  this  to  occur  it  is  necessary  that  the  diffennce  5 * 
[04a*(a)  4-  a“*^]  between  corre^nding  states  is  a zero- 
equivalent  state.  But  the  base  sute  5^  » [a~^.Sa^(a)]  is  a 
zero-equivalent  sute,  hence,  5 = [a“^,Sa*(a)]  + [o“i,a“^J 
is  a zero-equivalent  state  iff  Cx,x  * Caa-  Q£J>. 

It  is  easy  to  verify  that  the  two  4-tupies  5,(0),  5^(0), 
5,(0),  5,(0)  and  5,'(0).  8^(0),  5,'(0).  5,'(0)  in  Theorem  5 
with  [nxo,r>2o]  fo  either  [0,0]  or  [1,1]  lead  to  four 
even  numbered  sUtes  that  have  pairswise-identical  metric 
equations. 

Corollary:  The  4-tupie  of  pairs  of  odd  numbend  pannt 
sutes  of  Theonm  S gives  rise  to  4 even  numbend  sUtes  that 
have  pairswise  identical  metric  equations. 

Summarizing,  we  have  the  following  nsuits.  According  to 
Theorem  4,  the  odd  numbered  sutes  have  pairswise-identical 
metric  equations  for  codes,  such  as  codes  1 , 2.  and  4 of  Table 
in,  with  Cx,o  * Ca.©  * Cx,.  * C,..  * 1.  Hence,  for  such 
codes  2*“* , V ■ 2,  3,  —,  metric  and  path  register  combina- 
tions can  be  elimiiuted.  This  leads  to  a syndrome  decoder  of 
I'  of  the  hardwan  complexity  of  the  ^^terbi  decoder.  Accord- 
ing to  Theorem  S,  each  4-tuple  of  pairs  of  odd  numbered 
sutes  leads  to  two  pain  of  odd  numbered  states  that  have 
identical  metric  equatioiu  for  codes,  such  as  code  3 of  Table, 
in,  with  Cx,0  • ^2.0  * * I ^1,1  * 

.Ca,x’Cx.J^-x  * Ca,i_x.  Hence,  for  such  codes  an  additional 
2*~4,  IT  a 4,  s, metric  and  path  register  combiiutioru  can 
be  elimiruted.  According  to  the  corollary  to  Theorem  S,  the 
4-tuple  of  pain  of  odd  numbered  sUUs  mentioned  above  also 
leads  to  four  even  numbered  sutes  that  have  pairswise- 
identical  metric  equations.  This  leads  to  an  additional  aving  of 
2.2*“^  metric  and  path  register  combiiations.  The  total 
avings  for  codes  with  Cx.o  * C2,o  “ “ 1 and 

Cx.x  ■ C’2,x'C’x,i,-x  * C2.»-x  i*  thus  equal  to  2*“*  4- 
3i*“4,  V ■ 4, 5, — . The  resulting  syndrome  decoder  has  9/16 
of  the  hardware  complexity  of  the  Vlterbi  decoder.  Con- 
tinuing this  aries  of  reductions  the  ultinute  avings  in  metric 
and  path  register  combirutions  is  equai  to  2**~^  4-  3.2**“4  + 
3*.2'*~*  4-  — [9] , leading  to  a syndrome  decoder  of  hardware 
complexity  equal  to  ('|^^)*  times  the  hardware  complexity 
of  the  Vitetbi  decoder.  Note  that  in  order  to  achieve  this 
ultimate  avings  in  hardware  complexity  one  must  put  severe 
constraints  on  the  encoder.  Code  3 of  Table  m still  achieves 
the  maximum  free  distance  for  constraint  length  v « 4 codes. 
It  is  quite  conceivable,  however  that  in  putting  on  further 
constrainu  on  the  encoder  for  larger  values  of  v it  is  no  longer 
possible  to  achieve  the  maximum  free  distance.  However, 
by  only  requiring  Cx.o  “ ^2,0  * Cx..  ■ C2..  - 1,  and  Cx,x  » 
Qi,i  ana  riready  achieves  the  reduction  of 

7/16,  u shown  above. 

One  final  comment  is  in  order.  The  hardware  reduction 
with  respect  to  the  Vlterbi  decoder  has  been  equated  with  thg 
avings  in  metric  and  path  register  combinations.  Note  that  the 
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pith  registen  in  the  mydrome  decoder  are  used  to  store  the 
binary  oj-values,  compare  (S),  Le.,  they  are  binaiy  storage 
legisters  just  u are  the  path  registers  of  the  Viterbi  decoder. 
One  might  rentadt  that  the  path  registers  of  the  syndrome 
decoder  are  more  complex  because  eadi  state  has  four  possible 
parent  states  instead  of  two  as  in  the  Viterbi  decoder,  ffow- 
ercr,  by  fiUing  the  path  registers  serially  this  aspect  hardly 
adds  to  the  com^dexity. 

VI.  EXPERIMENTAL  RESULTS 

The  solid  lines  in  Rg.  6 give  the  measured  bit  error  probi' 
bility  of  code  3 of  Table  in  as  a function  of  the  transition 
probability  p of  the  binary  symmetric  cfaaimel  (BSC),  for  both 
a path  register  length  Z7  « 1 1 and  a path  register  length  D » 
16.  The  dashed  line  in  Rg.  6 is  a refinement  of  Van  De 
Meeberg’s  [4]  of  Vrterbi’s  upper  bound  on  the  bit  error  proba- 
bility. This  dashed  bound  is  valid  for  infinite  path  register 
length.  We  extended  Van  De  Meeberg’s  upper  bound  to  also 
apply  to  finite  path  register  lengths.  The  derivation  of  this 
extended  bound  will  be  published  shortly.  The  dashed  curves 
in  Fig.  6 give  the  upper  tound  on  the  bit  error  probability  for 
both  D » 11  and  D » 16.  It  is  clear  from  Fig.  6 that  it  does 
not  pay  to  Increase  the  path  register  length  mudi  beyond 
D*16. 

It  appears,  so  far,  that  the  syndrome  decoder  is  an  inter- 
esting (from  the  hardware  point  of  view)  substitute  for  the 
classical  Viterbi  decoder.  In  closing,  we  want  to  mention  two 
important  applications  of  the  syndrome  decoder  where  the 
classical  >fiterbi^  decoder  cannot  be  used.  These  applicatioiu 
are  in  feedbadi  communications  [S] , and  in  source  coding 
(data  reduction)  [6] . In  the  next  two  paragraphs  we  descrfte 
these  uses,  both  of  which  have  been  simulated  on  the  com- 
puter, of  the  syndrome  decoder,  respectively. 

Reference  [5]  describes  a coding  strategy  for  duplex  chan- 
nels that  enables  one  to  hansfer  the  hardware  or  the  program 
complexity  from  the  passive  (receiving)  side  to  the  active 
(transmitting)  side  of  the  duplex  chanrul.  As  pointed  out  in 
reference  [S] , this  coding  strategy  can  be  used  to  great  advan- 
tage in  a computer  network  with  a star  configuration.  For  the 
information  Sow  from  the  central  computer  to  the  satellites 
one  uses  the  duplex  strategy  thus  only  requiring  one  complex 
one-way  decoder  at  the  ceiural  facility.  For  the  information 
flow  from  a sateOite  computer  towards  the  central  facility 
one  uses  one-way  coding,  again  using  the  complex  one-way 
decoder  at  the  central  computer.  One  thus  uves  a number  of 
complex  one-way  decoders  equal  to  the  number  of  satellite 
computers  in  the  multiple  dialog  system  (MDS).  The  duplex 
strategy  [S]  requires  at  the  active  (transmitting)  side  of  the 
dnpiex  chnnei  an  estimate  of  the  forward  noise  Ri(a).  To 
fonn  this  estimate  Ai(a),  the  data  received  at  the  passive 
station  ate  scrambled  by  a convolutional  scrambler  C(a)  and 
sent  back  to  the  active  station.  At  the  active  station  one  can 
now  form  the  estimate  Ai(a)  using  the  Viterbi  decoder  for  the 
"systematic*’  convolutional  code  generated  by  an  encoder  with 
eoantctkm  polynomials  Cx(a)  > 1,  €2(0)  C(q).  It  is  well 

known  that  "nonsystematic”  convolutional  codes  are  more 
poaswftil  than  systematic  convolutional  codas.  With  our  syn- 


m pAtfWipkttr  11 


bound 


•i^fiifi«nt«4  rtouit  \\ 


10^ 

P%.  $.  Bit  etxor  rata  versus  cfaaiuel  trandtion  probability  p. 

drome  decoder  we  are  now  able  to  find  Ai(a)  according  to  a 
nonsystematic  code.  To  this  end  we  modify  the  feedback-fiee 
scrai^ler  C(a)  [S]  into  a feedback  scrambler  C3(a)/Cx(a),  see 
Fig.  7.  Note  thm  z(a)  according  to  Rg.  7 is  identical  to  (1). 
Hence,  we  can  use  our  syndrome  decoder  to  obtain  Ai(a). 
Fig.  8 gives  the  feedback  scrambler  for  the  convolutional  code 
generated  by  the  encoder  of  Rg.  1 . 

Note  that  the  syndrome  former,  Rg.  2,  has  two  input 
sequences  nx(a),  Rs(a)  and  one  output  sequence  r(a)  « 
Ca(a)nx(a)  Cx(a)rt3(a).  Thus,  the  syndronw  former  com- 
presses two  biiuuy  streams  Ri(a),  Rs(a)  into  one  stream  r(a) 
and,  hence,  achieves  a data  compression  of  a factor  of  2. 
estimator  part  of  the  syndrome  decoder  can  with  high  proba- 
bility of  being  correct  recover  the  original  sequences  Ri(aX 
'>s(ot)  given  the  compressed  data  sequence  z(a).  The  use  of 
a syndrome  decoder  for  data  compression  has  also  been 
studied  by  Massey  [6] . In  general,  to  obtain  a data  compres- 
sion factor  R,  R s 2, 3,  ■*■,  one  used  the  syndrome  decoder  of  a 
rate  -{r  — 1)/r  convolutional  code. 

Vn.  CONCLUSIONS 

This  paper  considers  the  syndrome  decoding  of  rate 
convolutional  codes.  Table  m shows  that  the  number  of 
metric  combiiutions  of  the  syndrome  decoder  is  sirull  com- 
pared to  the  number  of  metric  combinatioru  of  the  corre- 
sponding Viterbi  decoder.  For  the  constraint  length  v « 4 code 
of  row  3 of  Table  HI,  for  example,  the  number  of  metric  com- 
binations with  syndrome  decoding  is  1817,  whereu  the 
Vitert)i  decoder  for  this  same  code  has  over  IS  000  metric 
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combinatioiu.  Tliis  relatiwty  snull  number  of  metric  combina- 
tions for  smaQ  constraint  length  codes  enables  the  ROM- 
implementation  of  Section  IV,  that  eliminates  the  need  for 
metric  registers.  For  larger  constraint  lei^ths,  the  storage 
requirements  of  the  ROM  would  become  excessive.  However, 
by  putting  mild  constraints  on  the  encoder  it  is  possible  to 
eliminate  more  than  half  of  the  metric  and  path  register  com- 
binations. The  syndrome  decoder  of  code  3 of  Table  III,  for 
example,  only  requires  nine  path  registers,  whereas  the  corre- 
sponding >Aterbi  decoder  has  2*  « 16  path  registers. 

The  idea  of  syndrome  decoding  can  be  extended  to  rate 
-k/n  convolutional  codes.  Forney  [7],  [8]  desoftes  the 
mathematical  tools  necessary  to  find  the  general  syndrome 
former  equatioiu  and  the  equatioru  of  the  inverse  encoder. 

Note  added  in  proof:  A.  W.  J.  K(^  has  pointed  out 
a mistake  in  the  proof  of  Theorem  3,  i.e., 

Z>s'(a)C2(a)  a 0 is  incorrect.  The  proof  can  be  corrected 
by  observing  that  deg  [Ca(a)tx(o)  ***  Cx(a>s(a)]  > 
deg  px(“)*i(«)  + ^2(tt)»a(®)l  • 
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